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identification  of  what  are  referred  to  as'^job  dimensions.  Scores  on  these 
job  dimensions;  have  been  used  in  a series  of  studies  as  ‘the  basis  for  deriving 
estimates  of  the  aptitude  requi^rements  of  jobs  expressed  in  terms  of  test- 
related  data  based  on  the  nine-tests  of  the  General  Aptitude  Test  Battery 
(GATb)  of  the, United  States  Employment  Service.  The  results  of  such  invest-/ 
igations  have  indicated  rather  distinctly'fthat  the  PAQ  offers  substantial 
potential  as  the  basis  for/ the  estimation  of- aptitude  requirements  of  jobs. 

The  use  of  such  a procedure  (referred  to  as  job  component  validity)  would 
preclude  the  need  for  conventional  test  validation  of  tests  in  at  least  some 

circumstances.",  r'-'.  ~ 

(es 

This  study  deal t^ith/- the  use  of  the  PAQ  within  a job  component  validity 
framework  as  the  basis  for/,the  estimation  of  aptitude  requirements  of  jobs 
represented  by  scores  on  commercial ly-available  tests  as  contrasted  with 
scores  on  the  GATB  tests, 

The  general  procedures  involved  first  gathering  available  test  normative 
and/or  validity  data  for  incumbents  on  various  types  of  jobs,  these  test  data 
being  that  for  commercially-available  tets  that  represented  the  constructs 
covered  by  five  of  the  GATB  tests.  In  addition,  PAQ  analyses  were  obtained 
for  these  jobs,  either  from  the  organizations  from  which  the  test  data  were 
obtained,  or  from  corresponding  jobs  in  other  organizations  for  which  PAQ 
analyses  were  available  in  the  PAQ  data  bank. 

The  procedures  generally  consisted  of  the  use  of  job. dimension  scores 
based  on  previous  principal  components  analyses  of  the  PAQ  as  the  predictors 
of  four  types  of  test-related  criteria,  as  follows:  the  mean  test  scores  of 

incumbents  on  the  individual  jobs;  the  score  one  standard  deviation  below  the 
mean  of  the  incumbents  on  the  individual  jobs;  validity  coefficients ; and  an 
indication  as  to  whether  the  test  would  be  "valid." 

Analyses  were  carried  out  for  each  of  the  five  constructs  using  all  four 
criteria  for  those  jobs  for  which  adequate  test  data  and  PAQ  analyses  were 
available. 

A preliminary  report  (DeNisi,  Shaw,  and  McCormick,  1976)  reported  on 
the  results  of  such  analyses  for  a sample  of  96  jobs.  This  report  followed 
the  same  basic  procedures,  but  is  based  on  data  for  a larger  sample  of  jobs. 
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INTRODUCTION 


The  identification  of  tests  to  be  used  in  the  selection  of  personnel 
for  various  jobs  typically  has  been  accomplished  by  traditional  test 
validation  procedures.  These  procedures  are  at  best  time  consuming  and 
costly,  and  sometimes  cannot  be  carried  out  at  all  because  of  the 
limited  number  of  job  incumbents  available  for  study  or  for  other  reasons. 
Because  of  these  and  other  factors,  there  have  been  efforts  over  the 
years  to  develop  generalized  approaches  for  the  establishment  of  test 
batteries  for  personnel  selection  that  would  preclude  the  need  for  val- 
idation of  tests  in  each  and  every  job  situation.  The  notion  of  a 
generalized  approach  to  the  establishment  of  personnel  test  batteries 
was  initially  referred  to  by  Lawshe  (1952)  as  synthetic  validity,  and 
was  later  described  by  Balma  (1959)  as  follows:  “The  inferring  of 
validity  in  a specific  situation  from  a logical  analysis  of  jobs  into 
their  elements,  a determination  of  the  test  validity  for  those  elements, 
and  a combining  of  elemental  validities  into  a whole."  Since  the 
term  synthetic  validity  has  been  critized  as  not  being  specifically 
appropriate  for  such  a procedure,  McCormick  (1974)  has  suggested  the  use 
of  the  term  job  component  validity. 

Regardless  of  the  term  one  uses  to  refer  to  this  procedure,  the 
basis  of  any  such  procedure  is  rooted  in  some  type  of  systematic  job 
analysis.  In  this  regard,  McCormick  et  al. (1972)  indicate  that  the 
development  of  a procedure  for  establishing  the  job  component  validity 
of  predictors  for  jobs  would  consist  of  the  following:  (1)  some  method 
of  identifying  the  constituent  components  of  jobs  (which  are  referred 
to  as  job  elements  by  Balma);  (2)  a method  of  determining,  for  an 
experimental  sample  of  jobs,  the  human  attribute(s)  required  for  suc- 
cessful job  performance  as  related  to  those  job  components;  and 
(3)  some  method  of  combining  the  estimates  of  human  attributes  required 
for  individual  job  components  into  an  overall  estimate  of  the  human 
attribute  requirements  for  an  entire  job.  Such  a procedure  would 
make  it  possible  to  "build-up"  the  aptitude  requirements  for  any  given 
job  by:  (1)  knowing  what  job  components  occur  in  the  job  in  question; 

(2)  knowing  what  aptitudes  are  required  for  each  such  component;  and 

(3)  having  a procedure  for  summating  the  attribute  requirements  that 
are  relevant  to  the  individual  job  components. 

The  present  research  project  is  directed  toward  the  further  testing 
of  a procedure  for  the  establishment  of  the  job  component  validity  of 
tests  that  involves  the  use  of  the  Position  Analysis  Questionnaire  (PAQ). 
(ThePAQ  is  a structured  job  analysis  questionnaire  that  has  been  used 
as  the  basis  for  analyzing  jobs  for  the  purpose  of  establishing  the  job 
component  validity  of  personnel  tests.) 

A preliminary  report  of  this  effort  was  prepared  by  DeNisi,  Shaw, 
and  McCormick  (November  1976).  That  particular  report  summarized  the 
results  of  the  analyses  of  data  for  a sample  of  96  jobs  for  which  ap- 
propriate data  were  then  available.  This  report  is,  in  effect,  a 
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follow  up  of  that  based  on  a larger  sample  of  jobs  for  which  relevant 
data  have  been  obtained  since  the  preparation  of  the  preliminary  report. 
In  order  that  this  report  will  be  complete,  certain  background  sections 
of  the  preliminary  report  will  be  included  in  this  report  as  well. 

Conventional  Test  Validation  Procedures 


To  lend  some  background  to  the  rationale  for  seeking  some  general- 
ized approach  to  the  establishment  of  test  batteries  for  personnel  se- 
lection, it  would  seem  that  a brief  description  of  conventional  test 
validation  procedures  should  first  be  given.  Such  procedures  need  to 
be  carried  out  for  each  particular  job,  preferably  in  the  setting  of 
the  specific  organization  within  which  the  job  exists.  Such 
procedures  involve  the  following:  (1)  the  administration  of  an  experi- 

mental battery  of  tests  to  incumbents  who  are  already  on  the  job  in 
question  or  to  applicants  who  are  going  to  be  placed  on  the  job;  (2)  the 
obtaining  of  some  criterion  measure  of  job  performance  for  the 
individuals  who  have  taken  the  tests;  and  (3)  the  analysis  of  the 
statistical  relationships  between  the  test  scores  and  the  criterion 
of  job  performance.  Those  tests  for  which  a significant  relationship 
is  found  between  test  scores  and  job  performance  criterion  values 
can  then  be  used  for  the  selection  of  individuals  for  the  job  in 
question.  As  indicated  in  step  1 of  the  above  procedure,  there  are 
actually  two  variations  of  the  general  test  validation  methodology.  One 
of  these  is  a concurrent  procedure,  which  involves  the  use  of  a sample 
of  individuals  actually  on  the  job.  The  other  method,  which  is  referred 
to  as  predictive  validity,  consists  of  the  administration  of  the  tests 
to  candidates  for  the  job,  and  the  later  analysis  of  the  relationship 
between  test  scores  and  the  criterion  of  job  performance  after  the 
individuals  have  had  sufficient  time  to  be  able  to  demonstrate  their 
job-performance  abilities.  (In  the  case  of  predictive  validity,  the  test 
is  not  used  in  the  actual  selection  of  the  job  candidates  used  in  the 
validation  procedure.) 

Because  of  the  time  required  to  carry  out  these  procedures,  and 
because  such  procedures  cannot  be  carried  out  in  some  circumstances 
because  of  small  samples  or  for  other  reasons,  there  is  a fairly  obvious 
need  for  a "generalized"  validation  procedure. 

The  Position  Analysis  Questionnaire  (PAQ) 

Various  procedures  have  been  used  in  the  development  of  some  type 
of  job  component  or  generalized  validity  procedure.  One  of  these  has 
involved  the  use  of  the  Position  Analysis  Questionnaire  (PAQ).  The 
PAQ  is  a structured  job  analysis  questionnaire  that  provides  for  the 
analysis  of  individual  jobs  in  terms  of  187  job  elements.  In  the 
analysis  of  jobs  with  the  PAQ  job  elements,  various  rating  scales  are 
used  (the  particular  rating  scale  used  for  each  job  element  being  the 
one  for  which  the  concept  of  the  scale  seems  particularly  appropriate 
to  the  element).  Most  of  the  scales  are  six-point  scales,  ranging  from 
zero  (does  not  apply)  to-  five  (the  highest  value).  The  various  scales 
used  include  those  dealing  with  importance,  time,  extent  of  use,  and 
in  some  instances  special  scales.  In  certain  instances  a dichotomous 
scale  is  used.  The  dichotomous  scale  provides  for  indicating  whether 
the  job  element  in  question  does,  or  does  not,  apply  to  the  job. 
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Data  based  on  the  PAQ  have  been  subjected  to  various  principal  compon- 
ents analyses.  Two  earlier  analyses  were  carried  out  by  Jeanneret  and 
McCormick  (1969)  and  Marquardt  and  McCormick  (June  1974).  A more 
recent  one  has  been  carried  out  by  Mechain  (1977).  The  basic  pattern  of 
these  analyses  has  been  substantially  the  same.  In  the  first  place, 
separate  principal  components  analyses  were  carried  out  with  the  job 
elements  within  each  of  the  six  divisions  of  the  PAQ,  and  in  the  second 
place,  an  overall  analysis  was  carried  out  with  most  of  the  job  elements 
of  the  PAQ  included  in  the  same  analysis.  The  principal  components 
resulting  from  these  have  generally  been  referred  to  as  job  dimensions. 

The  most  recentanalyses  by  Mecham,  based  on  a sample  of  2200  jobs, 
probably  represents  the  most  adequate  set  of  job  dimensions,  primarily 
because  of  the  fact  that  the  sample  of  jobs  included  in  the  analysis 
was  somewhat  more  representative  of  jobs  in  the  labor  force  than 
either  of  the  previous  analyses.  Therefore  the  results  of  Mecham's  analysis 
will  be  used  in  this  study. 

The  analyses  by  Mecham  resulted  in  32  job  dimensions  as  based  on  the 
principal  components  analyses  of  the  job  elements  within  the  six  divisions, 
and  13  job  dimensions  based  on  an  overall  analysis.  These  are  listed  in  the 
appendix. 


Use  of  to  establish  job  component  validity.  One  of 

the  primar  the  PAQ  has  been  in  the  framework  of  establishing 

the  job  C'  idity  of  tests  for  various  jobs.  This  has 

consisted  . ly  of  the  analysis  of  samples  of  jobs  for  which  test 

data  for  uit  job  incumbents  were  available  from  the  United  States 
Employment  Service  (USES),  and  for  which  PAQ  analyses  were  available. 
The  USES  publishes  test  data  for  incumbents  on  several  hundred  jobs, 
the  tost  data  consisting  of  normative  and  validity  data  for  the  nine 
tests  of  the  General  Aptitude  Test  Battery  (GATB).  These  tests  are 
as  follows: 


G - Intel  1 igence  ! 

V - Verbal  Aptitude 
N - Numerical  Aptitude 
S - Spatial  Aptitude 
P - Form  Perception 
Q - Clerical  Perception 
K - Motor  Coordination 
F - Finger  Dexterity 

M - Manual  Dexterity  : 

As  the  primary  approach  to  the  use  of  PAQ-based  data  in  the  job 
component  validity  framework,  samples  of  jobs  were  selected  which 

"matched"  the  ones  for  which  the  USES  has  published  test  normative  and/  i 

or  validity  data.  In  these  analyses,  the  primary  criterion  of  the  ^ 

"importance"  of  a given  test  to  any  given  job  consisted  of  the  mean  i 

GATB  test  scores  of  the  incumbents  on  the  individual  jobs.  This  criterion  j 

was  based  on  the  assumption  that  individuals  tend  to  "gravitate"  into  1 

jobs  which  are  commensurate  with  their  own  abilities.  Thus,  it  would  ] 

be  assumed  that  jobs  for  which  the  incumbents  have  high  mean  test  scores  ] 
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on  a given  test  would  require  more  of  the  quality  measured  by  the  test 
than  jobs  for  which  the  incumbents  have  lower  mean  test  scores.  Using 
mean  test  scores  as  a criterion  of  the  "importance"  to  individual  jobs 
of  the  attributes  measured  by  the  various  tests,  the  scores  on  the  PAQ 
job  dimensions  were  then  used  in  a regression  procedure  for  the  predic- 
tion of  the  mean  GATB  test  scores. 

A second  criterion  of  the  importance  of  the  attributes  measured  by  the 
individual  tests  to  the  jobs  in  the  sample  consisted  of  the  validity 
coefficients  reported  by  the  USES. 

Two  studies  involving  the  use  of  these  two  criteria  have  been  carried 
out.  The  first  of  these,  by  Mecham  and  McCormick  (1969),  involved  a 
sample  of  PAQ  analyses  for  179  positions  which  "matched"  90  jobs  for 
which  the  USES  published  test  data.  In  this  instance  the  PAQ  job  di- 
mensions that  were  used  as  predictors  were  those  developed  by  Jeanneret 
and  McCormick  (1969).  In  the  second  study  PAQ  analyses  for  659 
positions  were  matched  with  141  jobs  for  which  the  USES  had  published 
test  data  (Marquardt  and  McCormick,  July  1974).  In  the  case  of  both  of 
these  studies  the  prediction  of  the  mean  test  scores  of  the  incumbents 
from  PAQ  job  dimension  scores  was  quite  respectable.  However,  the 
prediction  of  the  validity  coefficient  criterion  was  not  as  good, 
perhaps  at  least  partially  because  of  the  wel 1 -recognized  problems 
associated  with  validity  coefficients  such  as  poor  criteria,  restricted 
range,  etc.  The  ranges  and  medians  of  the  multiple  correlations  across 
the  nine  GATB  tests  resulting  from  these  studies  are  given  below. 

Mecham  Marquardt 

Criterion  and  McCormick  and  McCormick 


Mean  test  scores 


Validity  coefficients 


Range 

. 59  to 

.80 

.46  to  .76 

Median 

.71 

.73 

Range 

40  to 

55 

26  to  44 

Median 

.47 

.39 

In  the  third  analysis  of  this  type  carried  out  by  Mecham  (1977),  data 
relating  to  the  PAQ  analyses  were  matched  with  163  jobs  for  which  the 
USES  had  published  test  data.  In  this  study,  however,  instead  of  match- 
ing individual  PAQ  analyses  with  these  163  jobs,  all  of  the  PAQ  analyses 
that  had  9-digit  code  numbers  from  the  Dictionary  of  Occupational  Titles 
(DOT)  were  "averaged"  to  represent  a "single"  PAQ  analyses  to  be  matched 
with  each  of  the  163  jobs  for  which  the  GATB  test  data  were  available. 
This  procedure  was  used  since  it  was  felt  that  the  "average"  PAQ  job 
dimension  scores  for  various  jobs  with  the  same  DOT  code  number  represent 
more  stable  values  for  the  jobs  than  individual  PAQ  analyses. 


In  that  study  both  sets  of  job  dimension  scores  were  used  as  predictors  of 
the  criteria  of  mean  test  scores  and  validity  coefficients.  Since  the 
division  job  dimensions  generally  resulted  in  better  prediction  than  the 
overall  dimensions,  only  the  division  job  dimensions  were  used  in  the  study 
covered  by  this  report. 


In  addition  to  the  criteria  of  mean  test  scores  and  validity  coefficients 
used  by  Mecham,  however,  another  criterion  of  the  "importance"  of  various 
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tests  to  the  jobs  in  question  was  used.  This  criterion  was  the  value  one 
standard  deviation  below  the  mean  of  test  scores  of  the  incumbents  on  the  in- 
dividual jobs.  This  criterion  might  be  viewed  as  a "potential/cutoff 
score."  Although  test  cutoff  scores  used  in  personnel  selection  iJbviously  vary 
with  the  labor  market  conditions,  it  is  probable  that^  in  general  terms, 
scores  one  standard  deviation  below  the  mean  would  more  nearly  ap- 
proximate typical  cutoff  scores  than  mean  scores  as  such.  This 
criterion  is  referred  to  as  "ISD  below  the  mean." 

j 

The  primary  results  of  Mecham's  analyses  are  presented  on  the  fol- 
lowing page  of  this  report,  since  they  are  not  yet  available  in  publications. 

In  all  three  studies  dealing  with  the  prediction  of  GATB  test-score 
criterion  values  from  PAQ  job  dimension  scores,  the  predictions  of  the  cog- 
nitive tests  were  best,  those  of  the  perceptual  tests  were  intermediate, 
and  those  of  the  psychomotor  tests  were  the  lowest.  Although  there 
were  differences  in  the  predictions  for  the  various  types  of  tests, 
the  general  level  of  predictions  was  viewed  as  demonstrating  the 
potential  utility  of  such  procedures  for  the  identification  of 
tests  for  use  in  personnel  selection.  It  should  be  noted  that 
the  predictions  based  on  Mecham's  job  dimensions  were  slightly 
better  than  those  based  on  the  dimensions  from  the  two  previous 
studies . 

OBJECTIVES  OF  THE  PRESENT  STUDY 

The  use  of  PAQ  job  dimension  scores  for  the  prediction  of  mean  ; 

GATB  test  scores  of  "hypothetical"  samples  of  job  incumbents  on  ® 

various  jobs  clearly  can  give  some  indications  of  the  aptitudes  , 

that  presumably  would  be  required  for  individual  jobs.  However, 

since  the  predictions  are  in  terms  of  GATB  test  scores,  and  since  ' 

the  GATB  tests  are  not  available  for  use  by  private  organizations,  ^ 

the  operational  use  of  such  predictions  would  necessitate  that  the  , 

predictions  in  terms  of  the  nine  GATB  tests  would  have  to  be  "cor>- 
verted"  into  tenns  corresponding  to  those  of  coimnercially-available 
tests.  Thus,  it  would  be  desirable  to  develop  some  procedure  for  use 
of  the  GATB  test  score  predictions  as  the  basis  for  the  selection  of 
corresponding  commercial ly-avai 1 abl e tests,  and  for  the  estimation 

of  scores  for  such  tests  which  correspond  to  those  of  the  GATB  tests.  ' 

Thus  one  could  use  predictions  of  appropriate  GATB  test  score  cut-  i 

offs  as  the  basis  for  deriving  estimates  of  cutoff  scores  on  other 

(corresponding)  tests  which  would  be  comparable  to  those  of  the  GATB  j 

test  in  question.  The  basic  objective  of  the  present  study  has  been 

that  of  developing  some  procedure  for  shifting  from  the  prediction 

of  GATB  test  scores  to  the  prediction  of  scores  on  commerci al ly-avai 1 - 

able  tests  that  presumably  correspond  with  those  of  the  several  GATB 

tests . 

There  are  two  possible  general  aoproaches  to  the  "matching"  of  GATB 
and  commercial ly-avai lable  tests  that  miglit  serve  as  the  basis  for 
converting  from  one  to  another.  The  preferable  approach  would  be  one 
for  which  data  are  available  fo»  Lwo  tests  that  are  based  on  the 
scores  of  the  individuals  in  a "general  population"  who  have  taken 
both  tests.  The  equ'valence  of  two  such  tests  would  best  be  reflected 
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by  a high  correlation  between  the  two.  In  turn,  corresponding  norms  for  the 
two  tests  preferably  should  be  available  for  the  general  population,  in 
order  to  make  it  possible  to  "convert"  scores  from  one  test  to  equivalent 
scores  on  another  test  in  terms  of  cither  standard  deviation  units  from  the 
mean,  or  in  teniis  of  percentile  nonns.  The  USES  has  published  data  on 
certain  commercial  tests  that  have  been  administered  to  the  same  samples  of 
individuals  who  have  taken  certain  of  the  GATE  tests.  These  data,  however, 
were  found  not  to  be  particularly  useful  for  this  study,  since  many  of  the 
tests  for  which  such  data  were  presen+ed  were  those  more  typically  used  in 
educational  circumstances  rather  than  for  personnel  selection.  Also  many 
of  the  samples  of  individuals  represented  'n  the  normative  data  consisted 
of  students  or  of  individuals  on  given  occupations  rather  than  of  the 
"general  population."  In  most  instances  normative  data  were  simply  not 
available. 

The  second  approach  is  one  in  which  a judgment  needs  to  be  made  about 
the  equivalence  of  test  content,  that  is,  the  equivalence  of  the  "construct" 
that  presumably  is  being  measured  by  the  two  tests  in  question.  This  is 
admittedly  a subjective  evaluation,  and  therefore  needs  to  be  approached 
with  caution.  In  the  case  of  some  pairs  of  tests  there  is  no  particular 
problem  in  making  a reasonably  valid  judgment  about  their  equivalence, 
but  in  the  case  of  other  tests  the  subjective  judgment  may  not  be  entirely 
valid.  In  those  instances  where  tests  are  considered  to  be  equivalent, 
there  is  of  course  the  further  possible  problem  of  conversion  of  norms  from 
one  test  to  those  for  the  second  test.  Many  of  the  norms  presented  in 
test  manuals  are  for  individuals  on  certain  jobs  or  in  various  job  groupings, 
without  there  being  norms  available  for  what  might  be  viewed  as  a "general"’ 
population.  (It'might  be  added  that  the  norms  for  the  GATE  tests  have  been 
based  on  a sample  of  4000  individuals  whose  jobs  are  reasonably  represent- 
ative of  the  major  occupational  groups  of  workers  in  the  labor  market. 
Therefore,  the  application  of  this  approach  preferably  would  require  the 
availability  of  a reasonably  comparable  set  of  norms  for  any  other  test  that 
would  be  considered  as  being  essentially  "equivalent"  to  one  of  the  GATE 
tests . ) 

METHOD 

The  primary  focus  of  this  study,  then,  was  to  develop  some  way  of  test- 
ing the  utility  of  a job-component  validity  model,  based  on  PAQ  job 
dimensions,  for  use  with  commercial ly-avai labl e tests.  To  accomplish  this 
it  would  be  necessary  to  translate  the  predictions  for  the  GATE  tests  made 
by  combining  the  PAQ  job  dimension  scores  into  terms  relevant  to 
commercial ly-avai 1 abl e tests  representing  similar  aptitude  constructs. 
Therefore,  this  study  was  viewed  as  a test  of  the  general i zabi 1 i ty  of  the 
PAQ-based  job-component  validity  model  that  has  been  heretofore  tested 
only  with  GATE  test  data. 

Sources  Of  Da ta 

The  basic  approach  used  has  been  that  of  obtaining,  from  various 
organizations,  data  from  any  validity  studies  that  they  had  carried  out 
for  jobs  in  their  organizations , as  well  as  obtaining  PAQ  analyses  for  any 
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such  jobs.  Several  approaches  were  used  in  an  attempt  to  obtain  such  j 

data,  including  the  following:  | 

1.  Direct  mailing  of  letters  to  several  hundred  organizations,  | 

explaining  the  goals  of  the  project  and  asking  them  to 

submit  any  relevant  test  data  they  had  available  (validity 
information  as  well  as  normative  data),  and  asking  them  to 
arrange  for  the  analysis  of  jobs  in  question  with  the  PAQ. 

2.  Establishing  contacts  with  various  test  publishing  firms, 
asking  them  if  they  had  any  validity  or  normative  data  on 
any  of  the  tests  which  they  published  for  incumbents  on 

specific  jobs.  | 

i 

3.  Mailings  to  consulting  firms  which  it  was  believed  were  i 

involved  in  test  validation  studies.  | 

4.  Mailings  to  former  graduate  students  of  Purdue  University.  j 

i 

5.  Appeals  made  in  certain  publications  which  it  was  felt  ^ 

had  the  audiences  that  it  might  be  useful  to  contact, 

asking  if  anyone  had  the  kinds  of  data  we  were  seeking. 

These  appeals  included  articles  in  The  Industrial  Psy- 
chologist (TIP)  (the  newsletter  of  the  Division  of 

Industrial/Organizational  Psychology  of  the  American  j 

Psychological  Association),  and  the  Personnel  Adminis-  h 

tra tor,  which  is  the  official  organ  of  the  American  ^ 

Society  for  Personnel  Administration.  i 


Although  these  several  approaches  were  used,  the  number  of  jobs  for  ’ 

which  test  data  and  PAQ  analyses  were  obtained  was  disappointing  by  small.  ^ 

In  the  case  of  certain  jobs  for  which  test  data  were  available  the  organ-  ^ 

ization  or  individual  furnishing  the  test  data  was  unable  pr  unwilling 
to  arrange  for  the  analysis  of  those  jobs  with  the  PAQ.  In  order  to 
include  these  jobs  in  our  sample,  it  was  decided  to  "match"  these  jobs 
with  jobs  which  had  already  been  analyzed  with  the  PAQ  and  which  were  in 

the  PAQ  data  bank  (presently  consisting  of  analyses  for  some  25,000  , 

positions).  This  matching  was  carried  out  on  the  basis  of  job  code 

numbers  from  the  Dictionary  of  Occupational  Titles  (DOT).  Where  possible  > 

this  matching  was  based  on  the  9-digit  code  numbers  of  the  DOT.  This 

matching  resulted  in  the  addition  of  30  jobs.  \ 

In  an  attempt  to  enlarge  the  sample  of  jobs,  some  archival  data 
were  used.  Such  data  consisted  mainly  of  validity  or  normative  data  4 

for  various  tests  for  incumbents  on  different  jobs  as  reported  in 

sources  such  as  the  Validity  Information  Exchange  of  Personnel , 

Psychology,  The  Handbook  of  Employee  Selection  (Dorcus  and  Jones,  1950), 
and  the  manuals  for  various  tests  commonly  used  in  industry.  The  PAQ 
analyses  for  the  jobs  for  which  data  were  obtained  through  these  sources 
had  to  be  obtained  by  matching  these  jobs  with  jobs  in  the  PAQ  data  bank. 

As  before,  this  was  done  on  the  basis  of  DOT  code  numbers.  This  archival 
source  yielded  data  on  an  additional  62  jobs,  bringing  the  total  sample  of 
jobs  up  to  202. 
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Constructs  Used  in  the  Study 

As  was  mentioned  above,  this  study  required  relating  data  on  a 
number  of  commercially-avai''able  tests  to  the  GATB  tests.  This 
presented  a bit  of  a problem  in  that  the  factorial  composition  of 
apparently  "similar"  tests  is  sometimes  quite  different,  and  thus 
two  tests  of,  for  example,  verbal  ability,  may  actually  be  testing 
somewhat  different  abilities  or  attributes.  Recognizing  this  prob- 
lem, it  was  nonetheless  decided  that  the  only  feasible  way  that 
this  study  could  be  carried  out  would  be  to  consider,  as  measures  of 
the  same  "construct,"  all  of  the  commercial ly-available  tests  that 
purport  to  measure  the  same  construct  as  that  represented  by  any 
given  GATB  test.  Although  the  actual  GATB  tests  were  not  available, 
there  is  information  published  concerning  the  general  nature  of 
each  subtest.  Thus,  for  example,  a test  of  "verbal  aptitude"  that 
consisted  primarily  of  reading  comprehension  items  would  not  be 
included  as  a test  of  the  "Verbal  Aptitude"  construct  as  measured 
by  the  verbal  (V)  GATB  test  used  in  this  study  to  represent  that 
construct. 

Since  the  entire  framework  of  this  study  revolved  around  the 
GATB,  it  was  tnly  natural  that  the  constructs  which  would  be  of 
interest  would  be  the  nine  measured  by  the  subtests  of  the  GATB, 
these  being  General  Intelligence  (G),  Verbal  Aptitude  (V),  Numeri- 
cal Aptitude  (N),  Spatial  Aptitude  (S),  Form  Perception  (P),  Cleri- 
cal Perception  (Q),  Motor  Coordination  ( K) , Finger  Dexterity  (F), 
and  Manual  Dexterity  (M).  The  commerci al 1 v-avai 1 able  tests  used 
to  measure  each  construct  are  given  in  the  appendix,  along  with  other 
publ ishers. 


Development  of  Equivalent  Norms  for  Tests 

Once  the  individual  tests  has  been  classified  as  measuring  a 
specific  construct,  it  was  then  necessary  to  develop  a method  of 
equating  scores  on  each  of  the  commercial ly-avail able  tests  used  to 
measure  the  construct  to  test  scores  on  the  GATB  subtests  for  that 
same  construct.  The  optimal  procedure  for  accompl ishing  this  would 
have  been  to  have  available  normative  test  data  for  a single,  general 
working  population  on  all  the  tests  within  a particular  construct. 
Such  data  were  not  available,  however,  and  other  methods  had  to  be 
employed.  These  methods  involved  the  combining  and  synthesizing 
of  general  norm  groups,  and  eventually  all  test  scores  were 
expressed  in  the  same  standard  score  units,  those  units  based  on  the 
standard  score  distribution  reported  for  the  GATB  tests.  The 
GATB  standard  scores  are  based  on  a mean  of  100  and  a standard 
deviation  of  20.  A more  detailed  explanation  of  the  methods  employed 
to  develop  these  equivalent  norms  is  given  in  the  appendix. 
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As  a result,  for  any  construct,  it  was  possible  to  locate,  for  each 
job  for  which  test  data  for  a test  measuring  that  construct  were  avail- 
able, the  position  on  the  continuum  of  scores  on  the  construct  where  the 
sample  of  incumbents  on  that  job  would  fall.  It  was  the  scores  of  these 
incumbents  on  the  different  constructs  that  were  used  as  criterion  values 
of  mean  test  scores  and  of  "ISD  below  the  mean"  in  this  study,  such 
criterion  values  for  various  jobs  being  viewed  as  reflecting  the  relative 
"importance"  to  the  jobs  in  question  of  the  construct  in  question. 

Actual  Criteria  Used 


As  indicated  above,  four  criteria  as  related  to  individual  jobs  were 
used  in  various  phases  of  the  study,  these  being  considered  as  reflecting 
various  indices  of  the  "importance"  to  the  individual  jobs  of  each  of  the 
nine  constructs  as  represented  by  the  GATB  tests.  These  criteria  for 
each  job  and  for  each  test,  consisted  of:  ;(1)  mean  test  score  pf  thejob 
incumbents  on  the  individual  job;  (2)  the  test  score  one  standard  deviation 
below  the  mean  of  the  scores  of  incumbents  in  each  job,  referred  to  as 
"ISD  below  the  mean;"  (3)  a coefficient  validity;  and  (4)  an  indication  of 
whether  the  test  would  be  "valid"  for  the  job.  The  first  two  of  these  were 
considered  to  be  the  primary  criteria  used  in  the  study.  Considering  for 
a moment  the  criterion  of  mean  test  scores  of  incumbents  on  the  individual 
jobs,  one  could  view  a continuum  for  each  of  the  nine  constructs  expressed 
in  standard  score  form  with  the  mean  scores  of  incumbents  on  the  various 
jobs  falling  in  various  positions  along  that  continuum,  from  low  to  high. 

(As  indicated  earlier,  the  conversion  of  the  norms  of  the  commercially- 
available  tests  to  the  standard  score  forms  of  the  GATB  tests  served  as 
the  comnon  metric  for  relating  the  mean  scores  of  incumbents  on  that 
continuum.)  "ISD  below  the  mean"  might  be  viewed  as  a "potential"  cut- 
off score. 

In  the  case  of  the  criterion  of  validity  coefficients  it  was  of 
course  not  necessary  to  be  concerned  about  the  "normative"  data  that  were 
used  with  the  criteria  of  mean  test  scores  and  "ISD  below  the  mean." 

Rather,  for  any  given  construct,  the  coefficients  of  validity  of  the  tests 
which  were  considered  to  represent  that  construct  could  be  viewed  as 
representing  a continuum  from  low  to  high  as  expressed  by  the  actual  co- 
efficient values  themselves.  In  the  case  of  certain  analyses  the  fourth 
criterion  was  used,  namely  an  indication  as  to  whether  individual  tests 
would  be  "valid"  predictors  of  performance.  This  criterion  was  based  on 
the  question  as  to  whether  the  initial  coefficient  of  validity  for  that 
test  itself  was  one  which  was  statistically  significant  or  not.  (See  the 
discussion  in  the  next  section.)  . 

Development  of  Predicted  Criterion  Values 

Two  basic  types  of  predicted  criterion  values  were  used  in  the  study. 
One  of  these  was  based  on  job  dimension  scores,  and  the  other  involved  the 
use  of  "attribute-based"  data. 

Predicted  criterion  values  based  on  job  dimension  scores.  In  the  use 
of  job  dimension  scores  for  deriving  predicted  criterion  scores,  the 
predicted  values  for  the  individual  jobs  were  derived  from  a standard  com- 
puter printout  of  data  that  is  printed  from  the  PAQ  analysis  of  any 
given  job.  These  computer  printouts  are  based  on  previous  analyses  of 
PAQ-based  data  as  related  to  the  published  USES  test  data  mentioned 
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previously.  Such  data  include,  for  each  of  the  sample  jobs,  and,  for 
each  GATB  test,  estimates  of  the  mean  test  score  of  job  incumbents, 
the  "ISD  below  the  mean,"  and  the  validity  coefficient.  The  computer 
printout,  based  on  regression  analyses  of  PAQ  job  dimension  scores 
as  related  to  these  three  values,  provides  estimates,  for  any  given 
job,  of  the  first  three  criteria.  In  connection  with  the  fourth  cri- 
terion the  computer  program  on  wnich  these  computer  printouts  are 
based  also  includes  provision  for-  making  a prediction  about  those  tests 
(usually  three)  which  would  be  valid  predictors  for  performance  on 
the  job  in  question.  This  particular  aspect  of  the  program,  in  e'f'fect, 
is  a "policy  capturing"  procedure  that  parallels  the  practice  of  the 
USES  in  its  approach  tc  the  identification  of  the  three  "best"  or  most 
"valid"  tests  for  use  in  the  selection  of  individuals  for  any  given  job, 
and  in  establishing  cut-off  scores  for  those  three  tests.  The  PAQ 
printout,  in  effect,  provides  estimates  of  the  cutoff  scores  of 
those  three  tests.  Thus,  for  any  given  job,  the  fourth  criterion 
consists  of  the  indentification  of  three  tests  which  are  predicted 
to  be  the  most  "valid"  for  use  in  selecting  people  for  any  given  job, 

based  on  USES  practices  in  this  area,-  In  practice,  a prediction  was 
made  from  the  PAQ  as  io  whether  each  test  would  or  would  not  be  one 
of  the  three  "valid"  predictors.  Each  such  prediction  was  then 
compared  with  the  actual  criterion  data  in  terms  of  whether  the  test 
was  or  was  not  "val id. " 

Predicted  criterion  val ues  involving  "attribute-based"  data.  The 
use  of  the  "attribute-based"  data  for  deriving  predicted  criterion  values 
was  predicated  on  the  rated  "attribute  requirements"  of  the  PAQ  elements 
(Marquardt,  1972;  and  Mecham,  1968).  Such  ratings  were  made  by  psy- 
chologists on  each  of  49  "apti tudinal"  attributes  and  27  "situational" 
attributes  that  were  considered  to  be  potentially  relevant  to  the  world 
of  work.  (The  situational  attributes  consist  of  descriptions  of  work 
situations  to  which  job  incumbents  presumably  have  to  "adjust,"  such 
as  "varied  duties,”  "dealing  with  people,"  and  "working  alone."  They 
are  considered  to  have  implications  in  terms  of  personality,  temperament, 
and  interest  factors.)  The  median  ratings  on  these  attributes  for  any 
given  job  element  comprise  the  "attribute  profile"  for  that  element. 
Previous  studies  (Mecham,  1970;  Marquardt,  1974;  and  Shaw  and  McCormick, 
1976)  have  shown  that  the  use  of  "attribute-based"  data  has  potential  for 
serving  as  the  basis  for  "building  up"  estimates  of  the  total  aptitude 
requirements  for  jobs  for  at  least  certain  types  of  aptitudes. 

Mecham  (1970)  and  Shaw  and  McCormick  (1976)  used  two  methods  of 
combining  attribute-based  data  for  building  up  these  estimates  of  apti- 
tude requirements.  The  first  of  these  involved  the  use  of  a combination 
of  PAQ  job  analysis  ratings  on  individual  jobs  and  of  the  attribute 
ratings  on  individual  job  elements.  The  second  method  involved  the  use  of 
"attribute  dimension  scores"  based  on  a combination  of  PAQ  job  analysis 
ratings  on  individual  jobs  and  individual  attribute  ratings  for  the  job 
elements.  Since  these  two  studies  revealed  relatively  little  practical 
difference  between  these  two  procedures,  the  present  study  utilized  the 
first  procedure  only. 
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The  procedure  for  arriving  at  estimates  of  the  attribute  requirements 
for  each  of  the  202  jobs  in  the  present  sample  is  shown  below: 


Illustration  of  Method  of  Deriving  Estimates  of 
Attribute  Requirements  of  Jobs  Based  on  Attribute  Ratings  of 

Job  Elements  of  the  PAQ 


Hypothetical  job  analysis 
ratings  on  5 PAQ 
job  elements  for  1 

job  X j 

. ] 

' Median  attribute 

ratings  for  job 
elements  of  the 
PAQ 

' Cross-product  matrix 
resulting  from  job 
analysis  ratings 
x attribute  ratings 

1 

Attribute 

Attribute 

Element  Rating 

1 1 2 3.. . 71 

1 2 3...  71 

1 2 

1 

|5  0 3 1 

10  0 6 2 

2 3 

2 14  1 

1 6 3 12  3 

3 5 

1 1 0 5 0 

, 5 0 25  0 

4 0 

1 5 4 0 2 

0 0 0 0 

5 5 

! 3 5 2 1 

15  25  10  5 

Estimate  of 

attribute  requirements 

36  28  53  10 

1 

1 

For  each  job,  a column  vector  consisting  of  the  PAQ  job  analysis  ratings 

for  that  job  was  multiplied  across  each  column  of  the  attribute  matrix  ^ 

consisting  of  the  median  ratings  of  the  various  attributes  for  the  PAQ 

job  elements.  Each  column  of  the  resulting  cross-product  matrix  was  j 

then  summed.  This  sum  represents  an  estimate  of  the  degree  to  which  j 

the  attribute  in  question  was  predicted  as  being  necessary  for  per- 
formance on  the  job  in  question.  This  procedure  was  carried  out  for 
each  job  in  the  sample,  thus  yielding  for  each  job  an  estimated  attri- 
bute requirement  for  each  of  the  71  attributes. 

Relating  Predicted  to  Actual  Criterion  Values  ■ 

Criterion  values  based  on  job  dimension  scores.  In  the  use  of  the  ] 

job  dimension  scores  as  predicted  criterion  values,  a distinction  was  ^ 

made  for  each  construct  represented  by  the  GATB  tests  between  job  I 

dimension  scores  for  individual  jobs  and  those  for  "job  families"  to  : 

which  individual  jobs  were  "assigned."  In  the  case  of  the  predictions  ’ 

to  be  made  on  the  basis  of  PAQs  for  individual  jobs,  the  predictions  of 
the  four  different  criteria  used  in  the  study  were  derived  from  the 

conventional  PAQ  computer  printouts  for  the  individual  jobs.  ; 

As  reported  in  Shaw,  DeNisi,  and  McCormick  (1977)  three  "sets" 

of  job  families  were  used  in  the  present  study.  These  three  sets  had 
been  formed  by  developing  a set  of  clusters  at  the  points  in  the  in- 

terativc  process  involved  in  the  cluster  analysis  at  which  the  indivl.d-  ' 

ual  jobs  in  the  sample  had  been  clustered  into  60,  40,  and  20  job 
families  (3  sets  of  clusters  with  60,  40  and  20  clusters  respectively). 


L = i 
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In  the  case  of  the  predictions  based  on  job  family  data,  each  individual 
job  was  allocated  to  the  job  family  with  which  it  was  most  closely 
affiliated,  '''his  was  done  on  the  basis  of  a index  of  relationship 
between  individual  jobs  and  the  "average"  job  dimension  scores  of  those 
jobs  which  had  been  previously  used  in  the  cluster  analysis  of  the  PAQ 
data,  and  which  formed  the  different  job  families. 

This  matching  process  was  carried  out  for  each  of  the  three  different 
sets  of  job  families.  Once  the  individual  jobs  in  the  sample  had  been 
matched  with  the  appropriate  job  family  in  each  of  the  sets  of  families, 
the  "average"  job  dimension  score  of  each  job  family  was  computed,  and 
was  then  used  to  predict  the  actual  criterion  values  nf  the  iobs  within 
that  family  just  as  if  it  was  a PAQ  analysis  for  an  individual  job. 

In  tne  case  of  the  predictions  based  on  individual  PAQ  analyses,  as 
well  as  those  based  on  job  family  data,  there  was  of  course  the  initial 
"selection"  of  jobs  for  which  relevant  test  data  were  available  for  the 
incumbents  as  related  to  any  given  construct.  In  addition,  given  those 
jobs  for  which  test  data  for  a given  construct  were  available,  there  was 
a further  selection,  for  individual  analyses,  of  the  types  of  test  criterion 
data  which  were  actually  available.  Thus,  for  any  given  construct,  a job 
would  be  included  in  the  analysis  for  any  particular  criterion,  depending 
upon  whether  actual  criterion  data  were  available  such  as  mean  test  scores, 
validity  coefficients,  or  an  indication  as  to  whether  a coefficient  was  or 
was  not  valid.  Thus,  the  analyses  consisted  of  a series  of  sub-analyses 
for  the  individual  constructs,  each  sub-analysis  consisting  of  data  for 
jobs  for  which  both  predicted  and  actual  criterion  data  were  available. 

In  this  process  the  actual  (or  obtained)  test  values  for  incumbents  on 
any  job  were  converted  to  standard  scores  on  the  constructs  involved.  The 
predicted  scores  were  all  in  terms  of  GATE  tests,  but,  since  the  constructs 
were  defined  in  terms  of  the  GATE  tests,  and  since  all  scores  were  in  a 
common  metric,  this  provided  no  problem.  The  actual  predicted  scores  them- 
selves were  the  result  of  combining  the  PAQ  job  dimension  scores  for  any 
job,  according  to  regression  equations  developed  in  earlier  research 
designed  to  predict  GATE  test  scores  from  PAQ  job  dimension  scores  (Mecham, 
1977).  These  equations  were  designed  to  yield  mean  test  scores,  the  "ISD 
below  the  mean"  criterion  values,  and  validity  coefficients,  as  well  as  to 
make  some  prediction  about  which  tests  should  be  valid  predictors  of  per- 
formance for  a job.  These  predictions  were  then  compared  to  the  actual 
criterion  data  in  these  areas  by  means  of  a series  of  correlational  analyses. 

Criterion  values  involving  "attribute-based"  data.  In  the  use  of  the 
attribute-based  data  the  data  relating  to  any  given  construct  involved  those 
jobs  for  which  relevant  test  data  were  available.  In  each  of  these  analyses 
the  mean  test  score  criterion  and  the  ISD  below  the  mean  criterion  were  used. 

The  predicted  criterion  values  involving  attribute-based  data  were  then 
correlated  with  the  actual  criterion  values  in  the  same  manner  as  used  with 
the  predicted  criterion  values  based  on  job  dimension  scores. 
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General  Analyses  with  Sample  Jobs 

With  this  final  sample  of  202  jobs  for  which  there  were  available  test 
data  from  either  an  organization  or  various  archival  sources,  as  well  as 
a PAQ  analysis  for  each  job,  the  following  operations  were  carried  out: 

1.  The  commercial ly-avail able  tests  for  which  data  were  now 

available  had  to  be  matched  to  individual  GATE  tests  which  i 

were  judged  to  measure  the  same  "constructs." 

2.  A method  had  to  be  developed  which  would  allow  the  equating 
of  the  norms  for  the  commercial  ly-avail able  tests  with  the 
norms  of  the  corresponding  GATE  tests. 

3.  Analyses  would  be  carried  out  relating  the  PAQ  predicted 

GATE  test  data  to  the  data  on  the  commercially-available  tests 
in  question.  In  various  phases  of  the  study  this  comparison 
would  revolve  around  all  or  some  of  the  following  four  criteria: 

(1)  the  mean  test  scores;  (2)  the  criterion  "ISD  below  the  mean;" 

(3)  validity  coefficients;  and  (4)  the  determination  of  whether 
or  not  the  test  would  be  a "val  id"  predictor  “of 'performance  for 
the  job  in  question. 

The  total  sample  then  consisted  of  data  for  202  jobs. 

The  sources  of  data  for  the  individual  jobs  are  given  in  the 
Appendix,  along  wit!i  indication  of  the  tests  for  which  test  data  for 
incumbents  on  the  individual  jobs  were  available. 


Basis  of  Prediction  j 


Individual  Jobs 

Job  Families 

Criterion 

Job  Dimension 
Scores 

Attribute 

Data 

Job  Dimension 
Scores 

Attribute 

Data 

MEAN 

X 

X 

X 

"ISO  BELOW" 

X 

X 

X 

Not 

Relevant 

VALIDITY 

X 

— 

X 

■ 

VALID- 
NON  VALID 

X 

— 

X 

An  "X"  indicates  those  specific  analyses  that  were  carried  out. 
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RESULTS 

There  were  actually  several  sets  of  analyses  which  served  to 
replicate,  and  somewhat  expand  the  planned  analyses  outlined  earlier; 
all  will  be  reported.  The  results  will  be  divided  into  two  sections, 
one  for  the  analyses  based  on  job  dimension  scores  and  one  for  the 
analyses  based  on  the  attribute  profile  data. 

Analyses  Based  on  Job  Dimension  Scores 

The  results  of  the  correlations  between  predicted  and  obtained  scores 
on  all  four  criterion  indices  for  the  entire  sample  of  202  jobs  are 
reported  in  Table  1.  The  results  for  predictions  based  on  the  itidividual 
PAQs  as  well  as  on  the  data  for  20,  40  and  60  clusters  are  also  given. 

As  can  be  seen  in  Table  1,  the  predictions  based  on  the  individual  PAOs 
regarding  mean  test  scores  are  reasonably  satisfactory.  All  five 
correlations  are  significant  (four  of  them  beyond  the  .001  level)  and 
they  range  from  .35  (Spatial  Aptitude)  to  .71  (Verbal  Aptitude).  The 
results  for  the  three  sets  of  cluster  predictions  generally  follow  the 
same  pattern  as  for  the. individual  PAQ  predictions  (i.e.,  the  corr- 
elation for  Spatial  Aptitude  is  the  smallest,  and  that  for  Verbal 
Aptitude  is  the  largest).  However,  the  correlations  based  on  the  cluster 
data  are  generally  lower  than  those  based  on  individual  PAQ  analyses, 
especially  for  General  Intelligence  and  Spatial  Aptitude. 

The  results  obtained  for  the  scores  "1  SD  below  the  mean"  are 
similar  to  those  for  the  mean  test  scores.  All  five  correlations  are 
significant  (four  of  them  beyond  the  .001  level)  and  they  range  from 
.43  (Spatial  Aptitude)  to  .71  (Verbal  Aptitude).  An  exception  to  this 
pattern  is  that  the  correlations  for  Clerical  Perception  increased  from 
.38  for  the  mean  test  score  to  .60  for  the  value  1 SD  below  the  mean. 

The  sample  sizes  on  which  these  correlations  were  based  were  different, 
being  37  and  15  respectively.  However,both  correlations  are  signif- 
icant at  the  .05  level.  Again,  the  cluster  based  predictions  follow  the 
same  pattern  as  obtained  with  the  individual  PAOs  except  that  they  are 
generally  somewhat  lower,  especially  the  correlations  for  General 
Intelligence  (although  to  a lesser  extent  for  the  20  cluster  predictions) 
and  Spatial  Aptitude. 

It  might  be,  however,  that  the  results  for  the  prediction  of  mean 
test  scores  and  the  scores  1 SD  below  the  mean  were  not  really  comparable 
because  of  differences  in  the  samples  for  these  two  analyses.  It  was 
therefore  decided  to  carry  out  a similar  analysis  for  only  those  jobs  for 
which  data  on  both  criterion  indices  were  available.  The  results  for 
prediction  of  both  mean  scores  and  scores  1 SD  below  the  mean  on  this 
"matched  sample"  are  also  given  in  Table  1.  In  this  analysis  all  five 
correlations  for  both  criterion  indices  are  also  significant,  but  the 
correlations  are  generally  higher  than  for  the  "complete"  sample. 

Further,  the  correlations  for  these  two  criteria  are  closer  together 
for  the  individual  criteria  than  in  the  case  of  the  "complete"  sample. 
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Table  1 

Correlations  Between  Predicted  and  Actual 
Test-related  Criteria  for 
Five  Constructs:  Total  Sample 


Criteria  and  Individual  Cluster-based  predictions  

Constructs  PACjs ^0  Clusters  4u  Clusters  60  Clusters N 


Mean  Test  Scores;  Complete  Sample^ 
General  Intelligence  .51*** 

.15 

.09 

.13 

Ill 

Verbal  Aptitude 

^ 7 ] ★★★ 

.65*** 

.67*** 

.70*** 

50 

Numerical  Aptitude 

, 40*** 

.39*** 

, 46*** 

^ 44*** 

162 

Spatial  Aptitude 

.35*** 

.13 

-.08 

.07 

123 

Clerical  Perception 

.38* 

. 46*** 

. 44** 

.50*** 

37 

1 SD  Below  Mean:  Complete  Sample^ 

General  Intelligence  .46*** 

.22* 

.11 

.15 

no 

Verbal  Aptitude 

^ 7 ] *★* 

.62*** 

.68*** 

.60*** 

50 

Numerical  Aptitude 

^ 44*** 

.36*** 

. 46*** 

.43*** 

141 

Spatial  Aptitude 

.43*** 

.01 

.03 

.01 

102 

Clerical  Perception 

.60* 

.42 

.44 

.39 

15 

2 

Mean  Test  Scores-Matched  Sample 
General  Intelligence  .50*** 

.13 

.05 

.12 

no 

Verbal  Aptitude 

^ 71*** 

.65*** 

.67*** 

.60*** 

50 

Numerical  Aptitude 

.43*** 

, 41 *** 

.50*** 

47*** 

141 

Spatial  Aptitude 

.40***  ” 

.13 

-.10 

-.13 

99 

Clerical  Perception 

.53* 

.44 

.37 

.37 

15 

2 

1 SD  Below  Mean-Matched  Sample 
General  Intelligence  .46*** 

.22* 

.11 

.15 

no 

Verbal  Aptitude 

7 1 ★★★ 

.62*** 

.68*** 

.60*** 

50 

Numerical  Aptitude 

44*** 

.36*** 

, 46*** 

.43*** 

141 

Spatial  Aptitude 

.43*** 

.01 

.06 

.04 

99 

Clerical  Perception 

.60* 

.42 

.44 

.39 

15 

Validity  Coefficients 

General  Intelligence 

-.54 

.37 

-.14 

-.14 

13 

Verbal  Aptitude 

.30 

.53*** 

. 58*** 

.28 

36 

Numerical  Aptitude 

.23* 

.12 

^ 47*** 

76 

Spatial  Aptitude 

.26 

.29 

.25 

.35* 

43 

Clerical  Perception 

-.02 

.03 

.16 

.32* 

29 

Val id-NonVal id  , 

General  Intelligence 

.17 

J 

- 

- 

13 

Verbal  Aptitude 

-.18 

- 

- 

- 

36 

Numerical  Aptitude 

.19 

- 

- 

- 

76 

Spatial  Aptitude 

.76*** 

- 

- 

- 

41 

Clerical  Perception 

. 51** 

- 

- 

- 

29 
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Table  1 (Cont.) 

Vhe  "complete  sample"  represented  by  this  table  includes  all  jobs  for  which 
mean  test  score  data  were  available. 

2 

For  these  analyses,  only  jobs  for  which  data  were  available  on  both  mean 
test  scores  and  scores  "1  SD  below  mean"  were  used.  This  was  done  to 
eliminate  any  differences  between  the  results  for  these  two  criterion 
indices  due  only  to  different  samples. 

3 

There  were  no  analyses  conducted  on  the  "Val id-NonVal id"  criterion  for 
the  clusters. 


*Significant,  p<.05 
**Signi ficant,  p^  .01 
***Significant,  p<  .001 
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The  results  for  the  two  criterion  indices  dealing  with  validity 
coefficients  (the  coefficient  itself  and  the  valid-nonvalid  criterion) 
are  disappointing  (As  indicated  before,  however,  previous  analyses 
with  the  criterion  of  validity  coefficients  have  also  resulted  in 
limited  predictions.)  For  the  predictions  based  on  the  individual 
PAQs  only  one  correlation  predicting  validity  coefficients  was  sig- 
nificant (Numerical  Aptitude)  and  two  were  actually  in  the  negative 
direction,  the  range  going  from  -.54  (General  Intelligence)  to  .30 
(Verbal  Aptitude).  The  results  for  the  valid-nonvalid  criterion 
were  only  slightly  better,  with  two  of  the  correlations  being  signif- 
icant, the  range  going  from  -.18  (Verbal  Aptitude)  to  .76  (Spatial 
Aptitude).  Although  there  were  no  cluster  based  predictions  of  the 
valid-nonvalid  criterion,  the  predictions  of  validity  coefficients 
for  the  clusters  produced  rather  interesting  results.  The 
correlations  tend  to  be  higher  for  the  cluster-based  predictions 
than  for  the  predictions  based  on  individual  PAQ  analyses;  also 
there  are  relatively  more  significant  correlations  for  the  cluster 
based  predictions.lt  is  likely  that,  by  averaging  PAQ  profiles 
within  clusters,  some  of  the  error  variance  due  to  the  generally 
low  predictive  ability  of  PAQ  data  relative  to  validity  coefficients, 
has  been  eliminated,  thus  resulting  in  higher  correlations  when  jobs 
are  assigned  to  clusters. 

Although  these  results  are  reasonably  respectable,  there  was 
one  portion  of  the  sample  that  presented  problems.  Data  for  79  jobs 
were  from  one  organization  (hereafter  referred  to  as  "Company  X") 
and  all  test  data  from  this  company  were  based  on  "special"  or 
in-house  tests  (see  Appendix  A).  Furthenonore,  the  test  data  received 
from  that  organization  were  available  in  terms  of  only  seven  clusters 
of  jobs.  In  the  present  study  each  of  these  79  jobs  was  treated  as  an 
individual  job.  Therefore  for  the  jobs  in  one  job  family  from  Company 
X there  were  as  manv  sets  of  predictions  as  there  were  jobs  in  the 
group,  but  only  one  set  of  criterion  test  data.  This  fact  was  seen  as 
a potentially  contaminating  factor  in  the  analyses,  and  it  was  decided 
to  conduct  an  additional  series  of  analyses  eliminating  those  jobs  from 
Company  X.  This  reduced  the  size  of  the  total  sample  to  123  and  the 
results  obtained  with  this  smaller  sample  are  given  in  Table  2. 

As  can  be  seen  in  Table  2,  the  results  with  this  smaller  sample  are 
generally  better  than  those  obtained  with  the  total  sample  of  202  jobs. 

The  predictions  of  mean  test  scores  still  produce  five  significant  corr- 
elations for  the  individual  PAQ  predictions,  the  range  now  being  from 
.30  (Spatial  Aptitude,  the  only  prediction  to  suffer  in  the  smaller 
sample)  to  .74  (General  Intelligence).  The  more  marked  improvement, 
however,  comes  with  the  three  sets  of  cluster  based  predictions.  Although 
the  correlations  are  still  somewhat  lower  than  those  obtained  with  the 
predictions  based  on  individual  PAQ  analyses,  now,  for  each  set  of 
clusters,  at  least  four  of  the  correlations  are  significant. 

The  results  for  the  criterion  of  scores  1 SD  below  the  mean  show 
even  more  improvement.  Again  all  five  correlations  are  significant, 
but  the  range  of  these  is  higher,  being  from  .60  (Clerical  Perception) 


19 


to  .71  (Verbal  Aptitude).  Also,  for  each  set  of  cluster  based  pre- 
dictions, in  this  analysis  four  of  the  correlations  are  significant; 

(the  correlations  for  predictions  of  Clerical  Perception  are  not 
significant  for  any  cluster).  In  addition  the  magnitudes  of  these 
cluster  based  correlations  are  much  closer  to  those  obtained  with  the 
individual  PAQs. 

Since  in  the  case  of  the  criteria  of  mean  test  scores  and  of 
scores  1 SD  below  the  mean  there  were  different  numbers  of  jobs  in- 
cluded in  the  analyses  for  most  of  the  constructs,  some  of  the  dif- 
ferences in  the  results  with  these  two  criteria  might  be  due  in  part 
to  differences  in  the  samples,  as  in  the  case  of  the  jobs  in  the 
total  sample  of  202  as  presented  in  Table  1.  Therefore,  in  order  to 
make  possible  a clearer  comparison  of  predictions  with  these  two 
criteria,  additional  analyses  were  carried  out  for  those  jobs  for 
which  data  on  both  of  these  criteria  were  available,  there  being 
33  such  jobs.  The  results  for  these  "matched"  samples  are  also  given 
in  Table  2.  These  results  probably  are  most  representative  of  the 
relative  predicabi 1 i ty  of  PAQ-based  data  for  the  criteria  of  mean  test 
scores  and  scores  1 SD  below  the  mean,  since  they  are  based  on  the 
same  identical  sample  of  jobs,  and  since  the  potentially  contaminating 
influence  of  the  jobs  from  Company  X has  been  eliminated.  Those 
results,  also  presented  in  Table  2,  are  quite  v'espectabl e.  All  five 
correlations  for  the  mean  test  scores  are  significant  and  they  range 
from  .53  (Clerical  Perception)  to  .74  (General  Intelligence  and 
Spatial  Aptitude).  The  cluster  based  predictions  for  mean  test  scores 
are  also  quite  good  with  four  of  five  correlations  being  significant 
for  each  set  of  clusters.  Again,  predictions  of  Clerical  Ability  were 
poorer  for  the  clusters.  The  results  for  the  prediction  of  the  cri- 
terion of  scores  1 SD  below  the  mean  are  essentially  the  same  here 
as  for  the  complete  sample  (that  is  the  sample  before  matching)  and 
are  also  quite  good.  These  results  with  this  matched  sample  definitely 
provide  support  for  the  use  of  a PAQ-based  job  component  validity  model 
for  the  identification  of  aptitude  tests  for  use  in  personnel  selection. 

The  results  for  the  prediction  of  validity  data  are  not  substantially 
different  from  those  obtained  with  the  larger  sample  discussed  earlier. 
Once  again  the  majority  of  correlations  are  rather  disappointing.  It 
will  be  noted  in  Table  2,  however,  that  the  clusters  seem  to  do  a 
somewhat  better  job  of  predicting  validity  coefficients  and  the  valid- 
nonvalid  criterion  than  do  the  individual  PAQs. 

As  a further  analysis,  it  was  decided  to  derive  some  "overall" 
index  of  the  predictive  ability  of  the  individual  PAQs  and  of  the  cluster 
based  predictions.  This  comparison  was  made  with  the  results  for  the 
prediction  of  mean  test  scores  and  scores  1 SD  below  the  mean  for  the 
matched  data  in  the  smaller  sample  (i.e.  excluding  data  on  jobs  from 
Company  X),  since  it  was  these  data  that  were  probably  the  "cleanest". 

For  this  purpose  the  "averages"  of  the  correlations  of  the  five  con- 
structs were  computed.  These  are  given  in  Table  2.  The  average 
correlation  for  the  mean  test  scores  is  .66  for  the  individual  PAQs  and 
.52,  53,  and  51  for  the  three  sets  of  cluster  based  predictions.  For 
the  scores  1 SD  below  the  mean  the  average  is  .68  for  the  individual 
PAQs  and  .53,  .55,  and  .52  for  the  clusters. 
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Table  2 

Correlations  Between  Predicted  and  Actual 
Test- related  Criteria  for 
Five  Constructs:  Sample  Exclusive 

of  Jobs  from  "Company  X" 


Criteria  and 
Constructs 

Individual 

PAOs 

Cluster-based  predictions 
29  Clusters  40  Clusters 

60  Clusters  N 

1 

Mean  Test  Scores:  Complete  Sample 

General  Intelligence  .74*** 

.55*** 

.47** 

.50** 

34 

Verbal  Aptitude 

71  *★* 

,65*** 

.67*** 

.60*** 

50 

Numerical  Aptitude 

.56*** 

^ 49*** 

. 55*** 

.51*** 

85 

Spatial  Aptitude 

.30* 

.21 

.35** 

.19 

50 

Clerical  Perception 

.38* 

.46** 

.44** 

, 50*** 

37 

1 SD  Below  Mean:  Complete  Sample  ^ 

General  Intelligence  .66*** 

.63*** 

.49** 

.53*** 

33 

Verbal  Aptitude 

.71*** 

.62*** 

.68*** 

.60*** 

50 

Numerical  Aptitude 

.63*** 

_ 47*** 

^ 59*** 

.55*** 

64 

Spatial  Aptitude 

^ 72*** 

.43* 

.50** 

^47*** 

30 

Clerical  Perception 

.60* 

.42 

.44 

.39 

15 

2 

Mean  Test  Scores-Matched  Sample 
General  Intelligence  .74*** 

.52** 

.43* 

.52** 

33 

Verbal  Aptitude 

^ 71 ★** 

.65*** 

67*** 

.60*** 

50 

Numerical  Aptitude 

.67*** 

.52*** 

.61*** 

.56*** 

64 

Spatial  Aptitude 

74*** 

.44* 

.50** 

.47* 

26 

Clerical  Perception 

.53* 

.44 

.37 

.37 

15 

Average 

.66 

.52 

.53 

.51 

1 SD  Below  Mean-Matched  Sample^ 
General  Intelligence  .66*** 

.63*** 

.49** 

.53*** 

33 

Verbal  Aptitude 

71  **★ 

.62*** 

.68*** 

.60*** 

50 

Numerical  Aptitude 

.63*** 

^47*** 

.59*** 

. 55*** 

64 

Spatial  Aptitude 

.76*** 

.47* 

.51** 

.50** 

26 

Clerical  Perception 

.60** 

.42 

.44 

.39 

15 

Average 

.68 

.53 

.55 

.52 

Validity  Coefficients 

General  Intelligence 

-.54 

.37 

-.14 

-.14 

13 

Verbal  Aptitude 

.30 

.53*** 

.58*** 

.28 

36 

Numerical  Aptitude 

,25* 

.12 

.48*** 

, 40  *** 

76 

Spatial  Aptitude 

.26 

.29 

.25 

.35* 

43 

Clerical  Perception 

-.02 

-.03 

.16 

.32* 

29 

Val id-NonVal id 

General  Intelligence 

.17 

- 

- 

13 

Verbal  Aptitude 

-.18 

- 

- 

- 

36 

Numerical  Aptitude 

.19 

- 

- 

• 

76 

Spatial  Aptitude 

.76*** 

- 

- 

- 

43 

Clerical  Perception 

.51** 

“ 

- 

- 

29 

21 


Table  2 (Cent.) 

^The  "complete  sample"  represented  by  this  table  includes  all  jobs  for  which 
mean  test  score  data  were  available. 

2 

For  these  analyses,  only  jobs  for  which  data  were  available  on  both  mean 

test  scores  and  scores  " 1 SD  below  mean"  were  used.  This  was  done  to 
eliminate  any  differences  between  the  results  for  these  two  criterion 
indices  due  only  to  different  samples. 

3 

There  were  no  analyses  conducted  on  the  "Val id-NonVal id"  criterion  for  the 
cl usters . 


*Significant,  p<.05 
**Significant,  p<  .01 
***Significant,  pK.OOl 
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It  is  interesting  to  note  that,  although  the  predictions  were 
generally  better  for  the  individual  PAQs,  the  predictions  based  on 
the  three  sets  of  clusters  were  also  rather  respectable.  Perhaps  more 
interesting,  however,  is  that  there  are  no  real  differences  in  pre- 
dictive ability  for  the  three  sets  of  clusters.  This  is  surprising 
since  the  clusters  in  the  60  cluster  solution  are  much  more  homogeneous 
than  those  in  the  20  cluster  solution,  yet  predictions  based  on  these 
sets  of  clusters  are  virtually  identical.  This  raises  certain  questions 
and  suggests  further  research  on  the  problems  of  selecting  the  proper 
number  of  clusters  from  a hierarchical  grouping  procedure.  Differences 
in  the  results  obtained  with  different  cluster  solutions  may  not  be 
substantially  different,  and  perhaps  practical  considerations  should 
rule  in  the  selection  of  cluster  solutions. 

Finally,  one  additional  potential  source  of  contamination  remain- 
ing in  the  data  might  be  due  to  the  fact  that  test  data  from  different 
tests  were  combined  in  a "common  metric".  Not  only  could  the  collapsing 
of  all  the  data  into  a common  metric  have  an  effect  on  the  alignment 
of  test  scores,  but  if  there  were  problems  in  predicting  data  on  one 
particular  test  this  would  reduce  the  accuracy  of  predictions  for  a whole 
construct.  It  was  not  possible  to  deal  with  the  question  completely 
within  the  confines  of  the  present  set  of  data.  However,  it  was 
possible  to  get  some  inkling  of  how  well  PAQ-based. predictions  could 
do  in  predicting  test  data  based  on  individual  tests.  There  were  only 
four  tests  for  which  there  were  adequate  data  for  such  analyses,  these 
being:  the  Wonder! ic  Personnel  Test;  the  Employee  Aptitude  Survey,  Verbal 
and  Numerical  Tests;  and  the  Flanagan  Industrial  Tests-Ari thmeti c Test.  The 
results  for  these  tests  are  given  in  Table  3.  From  this  table,  it  can  be  seen 
that  the  results  with  the  first  three  were  markedly  superior  to  those  with  the 
Flanagan  Arithmetic  Test.  In  the  case  of  the  first  three  it  can  be 
seen  that  most  of  the  correlations  as  shown  in  Table  3 are  somewhat 
higher  than  the  corresponding  correlations  in  Table  2 (which  are  based 
on  data  from  two  or  more  tests  converted  to  the  common  metric).  One 
would  expect  such  improvement  since  the  data  are  based  on  single 
measuring  instruments.  At  the  same  time,  however,  the  data  in  Table  2 
for  the  "matched"  samples,  are  in  themselves  quite  respectable,  and  lend 
credence  to  the  notion  that  "pooled"  data  from  various  tests  that 
presumably  measure  the  same  construct  have  substantial  potential  in 
the  job  component  validity  model. 

Analyses  Based  on  Attribute  Data 

As  was  indicated  earlier  in  the  method  section,  two  types  of 
data  would  be  used  in  predicting  aptitude  requirements  for  jobs.  In 
one  case,  job  analysis  data  would  be  used  (these  results  were  pre- 
sented in  the  previous  section),  while  data  based  on  the  attribute 
ratings  of  PAQ  elements  would  be  used  as  a second  source  of  predictor 
data. 

Ten  human  attributes  were  selected  to  be  used  in  the  present  study. 

These  attributes  were  selected  because  it  was  felt  that  these 
attributes  most  closely  "matched"  the  types  of  abilities  covered  by  the 
five  GATE  constructs  used  in  this  study.  For  each  of  the  attributes  on 
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Table  3 


Correlations  Between  Predicted  and  Actual 
Test-related  Criteria  for  Three 
Constructs  Measured  by  Four  Specific  Tests 


Test  and 
Cri teria 

Individual  Cluster- 

PAQs  20  Clusters 

■based  predictions 
40  Clusters  60  Clusters 

N 

Wonderlic  Personnel  Test 

Mean 

.81*** 

.58*** 

.48** 

.53*** 

27 

1 SD  Below  Mean 

■ 75*** 

^ 72*** 

.55*** 

.62*** 

26 

Validity  Coefficient 

- 

- 

- 

“ 

Employee  Aptitude  Survey 

- Verbal 

Mean 

.80*** 

72*** 

.72*** 

.82*** 

24 

1 SD  Below  Mean 

.73*** 

.53** 

.62*** 

.73*** 

24 

Validity  Coefficient 

.12 

.27 

.26 

.20 

13 

Employee  Aptitude  Survey 

- Numerical 

Mean 

.66*** 

.48* 

.60*** 

.58** 

26 

1 SD  Below  Mean 

. 60*** 

.35 

.53** 

.51** 

26 

Validity  Coefficient 

-.24 

.23 

- 

.21 

15 

Flanaqan  Industrial  Tests  - Arithmetic 

Mean 

.40 

.24 

.43 

.17 

14 

1 SD  Below  Mean 

.52 

.26 

.40 

.19 

14 

Validity  Coefficient 

-.20 

.72* 

.08 

.34 

9 

^Insufficient  sample  size  to  carry  out  analyses 


*Significant,  p<.05 

**Significant,  p<  .01 

***Significant,  p<  .001 
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Table  4 

Correlations  Between  Predictions  Based  on 
Attribute  Data  and  Actual 
Test-related  Criterion  Data 
for  the  Total  Sample 


Attribute 

Criterion  and  Construct 

Correlation 

N 

Intel  1 igence 

Mean  Test  Scores 
General  Intelligence 

-.07 

111 

Verbal  Comprehension 

Verbal  Ability 

.42* ** 

50 

Word  Fluency 

M 

.43*** 

50 

Oral  Communication 

II 

.43** 

50 

Numerical  Computation 

Numerical  Ability 

.33*** 

163 

Arithmetic  Reasoning 

II 

.31*** 

163 

Visual  Perception 

Spatial  Ability 

-.3T*** 

125 

Spatial  Visualization 

II 

-.32*** 

125 

Spatial  Orientation 

II 

-.32*** 

125 

Verbal  Comprehension 

Clerical  Perception 

.63*** 

38 

Arithmetic  Reasoning 

II 

62*** 

38 

Closure 

II 

. 56*** 

38 

Visual  Perception 

II 

.42** 

38 

Intelligence 

1 SD  Below  Mean 
General  Intelligence 

.01 

no 

Verbal  Comprehension 

Verbal  Ability 

.43** 

50 

Work  Fluency 

II 

, 46*** 

50 

Oral  Communication 

II 

.44** 

50 

Numerical  Computation 

Numerical  Ability 

.26** 

141 

Arithmetic  Reasoning 

II 

.23** 

141 

Visual  Perception 

Spatial  Ability 

-.27** 

103 

Spatial  Visualization 

II 

-.32*** 

103 

Spatial  Orientation 

II 

-.28** 

103 

Verbal  Comprehension 

Clerical  Perception 

.51 

15 

Arithmetic  Reasoning 

II 

.36 

15 

Closure 

II 

.16 

15 

Visual  Perception 

II 

-.06 

15 

*Significant,  p<.05 

**Significant,  p<.01 

***Significant,  p<.001 
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each  of  the  jobs  in  the  sample,  predicted  criterion  scores  were 
developed  based  upon  a "cross-product  sum"  procedure  discussed 
earlier  in  the  method  section  (and  discussed  in  greater  detail 
in  Shaw  and  McCormick,  1977).  These  predicted  criterion  scores 
were  then  correlated  with  the  actual  criterion  scores  for  two 
criteria  for  the  jobs  in  the  sample,  namely  the  mean  test  scores  and 
the  scores  1 SD  below  the  means. 

The  results  of  this  analysis  are  reported  in  Table  4.  As  can  be 
seen  in  Table  4,  the  correlations  between  predicted  and  actual 
criteria  scores  were  "inconsistent"  across  the  various  constructs. 

For  example,  predictions  of  both  criteria  for  the  General  Intelligence 
construct  were  very  low  and  non-significant  (r  = -.07  for  mean  test 
scores,  and  .01  for  the  scores  1 SD  below  the  mean).  Correlations 
between  predicted  scores  and  actual  criteria  scores  on  both  criteria 
for  the  Spatial  Aptitude  construct  were  negative  in  direction  (r  = -.31). 
Prediction  of  mean  test  scores  for  Verbal  Ability,  Numerical  Ability 
and  Clerical  Ability  were  somewhat  more  reasonable  with  correlations 
ranging  from  .42  to  .43  for  Verbal  Ability  , .31  to  .33  for  Numerical 
Ability,  and  .42  to  .63  for  Clerical  Perception.  The  results  for  these 
constructs  for  the  criterion  of  1 SD  below  the  mean  were  very  similar 
to  those  for  the  mean  test  score  criterion.  The  correlations  ranged 
from  .43  to  .46  for  Verbal  Ability,  .23  to  .26  for  Numerical  Ability, 
and  -.06  to  .51  for  Clerical  Perception. 

In  general,  although  a number  of  correlations  were  of  reasonable 
magnitude  and  did  reach  statistical  significance,  the  results  seem 
to  indicate  a substantial  inconsistency  in  the  predictive  power  of 
the  data  based  on  attribute  ratings  of  the  PAQ  elements.  Because 
of  this  inconsistency  no  further  analyses  were  carried  out  with 
these  data. 

CONCLUSIONS 

On  the  basis  of  the  results  of  this  study  the  following  conclusions 
seem  to  be  warranted  regarding  the  use  of  data  from  the  Position  Analysis 
Questionnaire  (PAQ)  in  the  job  component  validity  model  as  the  basis  for 
establishing  aptitude  requirements  for  use  in  personnel  selection. 

1.  Such  a model  can  serve  to  identify  the  aptitude  tests  that  have 
substantial  validity  for  use  in  personnel  selection.  This  is  done  on 
the  basis  of  statistical  analyses  of  data  from  PAQ  analyses  of  individual 
jobs.  This  conclusion  is  supported  particularly  by  the  findings  re- 
garding the  predictability  of  mean  test  scores  of  job  incumbents  on 
various  jobs,  and  the  scores  of  job  incumbents  one  standard  deviation 
below  this  mean.  Such  predictions,  originally  based  on  test  data  for 
incumbents  on  the  nine  tests  of  the  General  Aptitude  Test  Battery 
(GATB)  of  the  United  States  Employment  Service,  also  hold  up  quite  well 
with  test  data  from  various  commercial  tests  that  were  considered  to 
measure  the  same  constructs  as  those  measured  by  the  GATB  tests.  (This 
analysis  was  based  on  five  of  the  nine  constructs.)  Results  of  the 
predictions  based  on  commercial  tests  resulting  from  this  study  are 


further  supported  by  a recent  study  by  Cunningham  et  al . (1976)  in 
which  the  Differential  Aptitude  Tests  were  used  in  much  the  same 
fashion. 
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2.  The  predictions  of  the  val idi ty- related  criteria  (those 
consisting  of  validity  coefficients  and  those  based  on  a "val id-nonval id" 
determination)  were  generally  not  very  satisfactory.  These  results  are 
generally  consistent  with  certain  previous  studies  in  which  the  predic- 
tion of  validity  coefficients  also  were  rather  poor. 

3.  In  most  cases  PAQ-based  predictions  of  test-related  criteria  for 
individual  commercial  tests  are  somewhat  superior  to  those  of  criteria 
derived  from  two  or  more  tests  that  have  been  pooled  together  as  measures 
of  the  same  construct.  However,  as  mentioned  above,  the  predictions  of 
mean  test  scores  and  scores  one  standard  deviation  below  the  mean  that 
are  based  on  "pooled"  test  data  are  also  quite  respectable. 

4.  Predictions  of  mean  test  scores  and  scores  one  standard  de- 
viation below  the  mean  that  are  based  on  job  families  (formed  from  PAQ 
data)  are  a bit  lower  than  those  based  on  PAQs  for  individual  jobs. 

They  are,  however,  of  such  magnitude  as  to  warrant  further  possible 
research  in  the  job  component  validity  model.  The  predictions  of  the 
criterion  of  validity  coefficients  based  on  job  family  data  actually 
tended  to  be  slightly  better  than  the  predictions  based  on  PAQ 
analyses  of  individual  jobs. 

5.  Predictions  based  on  job  families  resulting  from  the  20,  40,  and 
60  cluster  solutions  were  virtually  identical  to  each  other.  This  is 
interesting  since  one  of  the  problems  that  has  often  been  discussed 
relative  to  the  use  of  hierarchical  grouping  procedures  has  been  the 
decision  regarding  the  "optimal"  cluster  solution.  The  results  from 
this  study  suggest  that  the  number  of  job  families  used  in  the  job 
component  validity  model  may  not  be  critical,  although  further  research 
is  clearly  needed  in  this  area. 

6.  In  connection  with  the  criteria  of  mean  test  scores  and  the  scores 
one  standard  deviation  below  the  mean,  predictions  of  the  test-related 
criteria  from  the  attribute  data  are  not  nearly  as  consistent  as  those 
from  the  job  dimension  scores  based  on  PAQ  analyses.  Although  the 
predictions  from  the  attribute  data  were  reasonably  good  for  certain 
constructs,  they  were  very  poor  in  the  case  of  others.  Such  incon- 
sistencies have  been  found  in  previous  studies  as  well.  It  would  seem, 
therefore,  that  future  research  relating  to  the  use  of  attribute  data  for 
predicting  aptitude  requirements  of  jobs  might  well  be  focussed  on  the 
identification  of  the  particular  attributes  for  which  such  predictions  can 
be  made  with  reasonable  validity. 

7.  In  summary,  although  previous  research  with  the  use  of  the  PAQ  as 
the  basis  for  establishing  aptitude  requirements  for  jobs  within  the  job 
component  validity  framework  has  dealt  exclusively  with  test  data  from  the 
GATB  tests,  the  results  of  this  study  indicate  quite  clearly  that  such 
data  can  also  be  used  in  the  establishment  of  aptitude  requirements  in 
terms  of  commercial  tests  that  presumably  measure  the  same  constructs. 
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APPENDIX  B 


Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 

Construct:  General  Intelligence 


Common  Metric* 

Wonderl  ic^ 

2 

Adaptability 

Otis^ 

Learn, 

130 

34 

27 

67 

50 

129 

26 

128 

33 

66 

49 

127 

25 

65 

126 

32 

24 

64 

48 

125 

124 

31 

63 

123 

23 

62 

47 

122 

61 

121 

30 

46 

120 

22 

60 

119 

45 

118 

29 

59 

117 

21 

58 

116 

28 

44 

115 

57 

114 

56 

43 

113 

27 

112 

55 

42 

111 

26 

20 

no 

54 

41 

109 

53 

108 

25 

19 

107 

52 

40 

106 

24 

51 

105 

18 

39 

104 

50 

103 

23 

38 

102 

49 

101 

22 

48 

100 

17 

37 

99 

47 

98 

21 

16 

46 

36 

97 

96 

20 

45 

35 

95 

15 

94 

44 

34 

93 

19 

43 

92 

14 

91 

18 

42 

33 

90 

89 

13 

41 

32 

88 

17 

87 

40 

31 

86 

16 

12 

85 

39 

30 

84 

r — 
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Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  General 

Common  Metric* 

Intel  1 igehce 
Wonderl  ic^ 

2 

Adaptability 

Otis^ 

Learn. 

83 

15 

11 

38 

82 

29 

81 

14 

37 

80 

10 

36 

28 

79 

34,35 

78 

13 

33 

27 

77 

9 

32 

76 

12 

26 

75 

31 

26 

74 

8 

30 

73 

11 

25 

72 

29 

71 

10 

7 

28 

24 

70 

27 

69 

26 

23 

68 

9 

25 

67 

6 

24 

66 

8 

23 

22 

65 

22 

APPENDIX  B 
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Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  Verbal  Aptitude 


Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  Verbal  Aptitude 

Common  Metric*  PTI-V^  SET-V^  EAS-V^ 


83 

82 

81 

80 

79 

78 

77 

76 

75 

74 

73 

72 

71 

70 

69 

68 

67 

66 

65 


*The  common  tretric  used  in  the  conversion  of  test  scores  is  based  on 
a mean  of  loO  and  a standard  deviation  of  20.  This  is  the  same 
scale  used  with  the  GATB  tests., 

^Personnel  Tests  for  Industry  - Verbal 
2 

Short  Employment  T^sts  - Verbal 
3 

Employee  Aptitude  Survey  - Verbal 
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APPENDIX  B 


Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Comnwn  Metric 
for  Five  Constructs 


Construct:  Numerical  Aptitude 


Common  Metric* 

PTI-N^ 

SET-N  ^ 

EAS-N^ 

Arith.l.^ 

FIT-AR^ 

Arith.  Fun. 

130 

26 

54 

55 

42 

129 

53 

45 

41 

128 

52 

44 

54 

41 

127 

25 

51 

40 

126 

50 

43 

53 

125 

49 

42 

39 

124 

24 

52 

123 

48 

41 

38 

40 

122 

47 

40 

121 

23 

46 

51 

120 

45 

39 

37 

119 

44 

38 

50 

118 

22 

43 

36 

117 

37 

49 

39 

116 

42 

36 

38 

115 

21 

48 

35 

37 

114 

41 

35 

113 

20 

40 

34 

47 

34 

112 

39 

36 

111 

19 

38 

33 

46 

33 

no 

37 

32 

109 

18 

36 

45 

108 

31 

32 

34,35 

107 

35 

30 

44 

106 

17 

34 

31 

105 

32,33 

29 

43 

104 

16 

28 

30 

33 

103 

42 

102 

31 

27 

101 

15 

30 

26 

29 

100 

29 

41 

32 

99 

28 

25 

40 

28 

98 

14 

27 

24 

97 

27 

96 

13 

23 

39 

31 

95 

26 

22 

94 

12 

25 

38 

26 

93 

21 

92 

24 

20 

37 

25 

30,29 

91 

11 

23 

90 

19 

36 

24 

89 

22 

18 

88 

10 

35 

28 

87 

21 

17 

23 

86 

20 

16 

34 

85 

9 

22 

27 

84 

19 

15 

33 

26 

- ffr- 
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Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  Numerical  Aptitude 


Common  Metric* 

PTI-N^ 

SET-N^ 

EAS-N^ 

Arith. I.^ 

FIT-AR^ 

Arith. Fun^ 

83 

8 

14 

21 

25 

82 

18 

81 

17 

13 

32 

80 

7 

12 

20 

79 

16 

11 

31 

78 

77 

6 

15 

10 

30 

19 

24 

76 

75 

29 

18 

74 

5 

14 

9 

73 

13 

3 

28 

17 

72 

71 

12 

7 

27 

16 

23 

70 

4 

6 

69 

11 

26 

68 

10 

15 

67 

3 

5 

25 

22 

66 

14 

21 

65 

9 

4 

24 

* The  common 

metric 

used  in  the  conversion 

of 

test  scores 

is 

based  on 

a mean  of 

100  and 

a 

standard  deviation  of 

20 

. This  is 

the 

same 

scale  used 

with  the 

GATB  tests. 

^Personnel  Tests  for  Industry  - Numerical 
2 

Short  Employment  Tests  - Numerical 

3 

Employee  Aptitude  Survey  - Numerical 

4 

Arithmetic  Index 

6 

Flanaqan  Industrial  Tests  - Arithmetic 
^Arithmetic  Fundamentals  Test 


■i 


j 

) 

i 

1 

i 


t 
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Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  Spatial  Aptitude 


APPENDIX  B 


Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  Spatial 

Apti tude 

Common  Metric* 

MPFB^ 

EAS-S 

83 

26 

82 

38 

81 

37 

25 

80 

79 

36 

24 

78 

77 

35 

23 

76 

75 

34 

22 

74 

33 

73 

21 

72 

32 

71 

31 

20 

70 

69 

30 

19 

68 

67 

29 

18 

66 

28 

65 

17 

FIT-Ass^ 


6 


5 


4 


* The  common  metric  used  in  the  conversion  of  test  scores  is  based  on 
a mean  of  100  and  a standard  deviation  of  20.  This  is  the  same 
scale  used  with  the  GATB  tests. 

^Revised  Minnesota  Paper  Forms  Board 
2 

Employee  Aptitude  Survey  - Spatial 

3 

Flanagan  Industrial  Tests  - Assembly 
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Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Common  Metric 
for  Five  Constructs 


Construct:  Clerical 

Perception 

Coimion  Metric* 

EAS-VSA 

SET-C 

Minn. 

130 

111 

42 

165 

129 

no 

41 

162 

128 

109 

159 

127 

108 

40 

155 

126 

107 

151 

12'j 

106 

150 

124 

105 

39 

149 

123 

104 

147 

122 

103 

38 

146 

121 

102 

37 

144 

120 

101 

143 

119 

100 

36 

141 

118 

99 

140 

117 

98 

138 

116 

97 

35 

137 

115 

96 

136 

114 

95 

34 

134 

113 

94 

133 

112 

93 

33 

131 

111 

92 

129 

no 

92 

32 

127 

109 

91 

125 

108 

90 

123 

107 

89 

31 

122 

106 

88 

120 

105 

87 

30 

119 

104 

86 

118 

103 

85 

116 

102 

84 

29 

115 

101 

83 

113 

100 

82 

28 

112 

99 

81 

111 

98 

80 

27 

109 

97 

79 

26 

108 

96 

78 

106 

95 

77 

104 

94 

76 

103 

93 

75 

101 

92 

74 

25 

99 

91 

73 

98 

90 

72 

24 

97 

89 

71 

96 

88 

70 

95 

87 

69 

23 

94 

86 

68 

92 

85 

67 

90 

84 

66 

22 

88 
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Conversion  of  Scores  on  Various 
Personnel  Tests  to  a Coimion  Metric 
for  Five  Constructs 


Construct;  Clerical 

Perception 

Common  Metric* 

EAS-VSA 

SET-C 

Minn. 

83 

65 

87 

82 

64 

86 

81 

63 

84 

80 

62 

21 

83 

79 

61 

82 

78 

60 

80 

77 

59 

20 

79 

76 

58 

78 

75 

57 

19 

77 

74 

56 

76 

73 

55 

74 

72 

54 

18 

72 

71 

53 

69 

70 

52 

67 

69 

51 

17 

66 

68 

50 

65 

67 

49 

64 

66 

48 

16 

63 

65 

47 

62 

* The  common  metric 

used  in  the  conversion  of  test  scores 

is  based 

on  a mean  of  100  and  a standard 

deviation  of  20.  This 

is  the  same 

scale  used  with  the  GATB  tests. 

^Employee  Aptitude  Survey  - Visual 

Speed  and  Accuaracy 

Short  Employment  Tests  - Clerical 

3 

Minnesota  Clerical  Test  (Names  Only) 


1 
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Test  Publishers  for  Tests 
Used  in  this  Study 

Test  Publishers 


1.  The  Psychological  Corporation 

304  East  45th  Street 
New  York,  N.Y.  10017 

PTI  - Personnel  Tests  for  Industry  (Verbal  and  Numerical) 

SET  - Short  Employment  Tests  (Verbal,  Numerical  and  Clerical) 

Otis  - Otis  Self  Administering  Tests  of  Mental  Ability 

Minn.-  Minnesota  Clerical  Test 

MPFB  - Revised  Minnesota  Paper  Form  Board 

2.  Richardson,  Bellows,  Henry  5 Co.,  Inc. 

1 West  57^"  Street 
New  York,  N.Y.  10019 

Learn.  Ab.  - Test  of  Learning  Ability 
Arith.  Fund  - Arithmetic  Fundamentals  Test 

3.  Science  Research  Associates,  Inc. 

259  East  Erie  Street 
Chicago,  Illinois  60611 

Adaptability  - Adaptability  Test 
Arith.  I - SRA  Arithmetic  Index 

FIT  - Flanagan  Industrial  Tests  (Arithmetic  and  Assembly) 

4.  Psychological  Services,  Inc. 

4311  Wil shire  Boulevard,  Suite  600 
Los  Angeles,  California  90005 

EAS  - Employee  Aptitude  Survey  (Verbal,  Numerical,  Spatial  and  Visual 
Speed  and  Accuracy) 

5.  E.F.  Wonderlic  & Associates,  Inc. 

P.O.  Box  7 

Northfield,  Illinois  60093 
Wonderlic  - Wonderlic  Personnel  Test 
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APPENDIX  D 
Development  of  Norms 

In  order  to  carry  out  this  study,  it  was  necessary  to  have  all  test 
data  in  some  common  framework  - this  is,  all  test  scores  had  to  be 
expressed  in  terms  of  some  common  scale.  In  order  to  do  this,  it  would 
have  been  desirable  to  have  data  on  all  the  tests  used  in  this  study 
for  the  same  population.  This  was  clearly  not  possible.  Therefore, 
some  alternative  strategy  had  to  be  formulated.  Since  the  tests  of  the 
General  Aptitude  Test  Battery  (GATB)  of  the  United  States 
Employment  Service  were  used  as  the  criterion  tests  in  other  studies 
involving  the  PAQ  in  a job  component  validity  model  (Mecham  and 
McCormick,  1969;  Marquardt  and  McCormick,  1973),  it  was  decided  that 
the  norms  for  the  GATB  would  be  utilized  as  the  basic  framework.  The 
GATB  tests  are  reported  in  standard  score  form,  with  a mean  of  100 
and  a standard  deviation  of  20,  these  values  being  derived  from  test 
data  on  over  20,000  people  collected  by  the  United  States 
Employment  Service. 

The  major  problem,  however,  was  with  the  other  tests  that  would  be 
used  in  this  study.  Although  it  was  not  very  difficult  to  assign  any 
given  test  to  an  appropriate  construct,  since  the  "constructs"  utilized 
in  this  study  were  of  such  a broad  nature  (for  example,  it  seems  obvious 
that  the  Short  Employment  Test  of  Verbal  Ability  should  be  classified 
as  a "Verbal  Aptitude"  test),  there  is  no  body  of  data  indicating  the 
norms  for  these  tests  on  a "general"  population.  Not  only  were  the 
different  tests  used  with  different  populations,  but  for  most  tests  there 
was  not  a single  population  that  could  be  considered  as  a "general  working 
population"  for  which  norms  were  supplied.  Since  that  is  basically  what 
the  GATB  norms  are  based  on,  it  seemed  desirable  to  have  all  other  norms 
based  on  the  same  kind  of  population. 

The  first  problem,  then,  was  to  construct  general  norms  for  each  of 
the  different  tests.  The  seriousness  of  this  problem  varied  for  the 
different  tests.  For  example,  for  the  Employee  Aptitude  Survey  Tests, 
norms  are  provided  for  a general  working  population,  and  so  these 
norms  were  used.  For  the  Otis  Test  of  Mental  Ability,  norms  are 
provided  for  a general  population,  but  these  norms  are  given  separately 
for  males  and  females,  and  so  they  had  to  be  consolidated  into  a 
single  set  of  norms.  For  the  various  tests  published  by  the  Psychological 
Corporation  (viz.  The  Short  Employment  Tests  and  The  Personnel  Tests  for 
Industry),  no  general  norms  are  provided.  Rather,  there  are  norms  provided 
for  separate  occupational  groups.  In  general,  the  number  of  occupational 
groups  for  which  such  norms  were  provided  were  too  numerous  to  be 
reasonably  consolidated,  so  these  nonns  were  sampled.  That  is,  a number 
of  groups  which  seemed  to  have  "high"  norms  were  combined  with  a number 
of  groups  which  seemed  to  have  "low"  norms,  yielding  a single  set  of  norms 
which  it  was  felt  provided  a fair  representation  of  a norm  for  a "general" 
population. 

Thus,  for  each  test  a single  set  of  norms  was  constructed,  recogniz- 
ing that  the  populations  deemed  "general"  were  different  for  each  test. 
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Again,  there  was  no  way  to  avoid  this  lack  of  a single  "general"  population 
for  whom  scores  were  known  on  all  tests  used.  The  test  scores  which 
were  obtained  from  either  the  organizations  involved  m the  study,  or  any 
of  the  other  methods  discussed  earlier,  for  each  job,  were  then  stand- 
ardized on  the  general  norms  established  for  the  corresponding  GATB  test. 

This  resulted  in  a standard  score  for  each  test,  for  the  incumbents  on  , 

each  job,  reflecting  where  the  mean  for  incumbents  on  that  job  fell  on 
the  particular  construct  relative  to  all  other  jobs.  j 

The  problem  still  remained  of  converting  all  these  scores  to  some 
common  metric.  As  was  pointed  out  above,  the  GATB  norms  were  to  be 
used  as  the  framework  for  this  common  metric.  Since  one  set  of 
standard  scores  is  always  directly  convertible  to  any  other  set  of 
standard  scores,  the  scores  for  each  job  were  then  converted  into 
standard  scores  with  a mean  of  100  and  a standard  deviation  of  20.  For 
example,  if  the  mean  score  for  a sample  of  plumbers  happened  to  be  48 
on  the  Revised  Minnesota  Paper  Form  Board,  and  this  was  found  to  be 
equal  to  a standard  score  of  .50  based  on  the  general  population  norms 
constructed  for  that  test,  conversion  to  the  GATB  norms  was  simply 
a matter  of  multiplying  the  GATB  standard  deviation  of  20  by  .5,  (10), 
and  adding  this  this  to  the  GATB  norm  mean  of  100  (since  the  standard 
score  was  positive),  yielding  a GATB  standard  score  of  110.  This 
process  was  repeated  for  each  job  and  each  test  so  that  the  final  product 
was  a continuum  for  each  "construct,"  with  the  mean  scores  of  incumbents 
on  the  various  jobs  being  assigned  positions  on  this  continuum  based 
on  standard  scores  with  a mean  of  100  and  a standard  deviation  of  20. 

It  was  these  converted  scores  that  were  used  as  the  criterion  values  of 
"mean  test  scores"  used  in  this  study.  Thus,  since  the  PAQ  based 
predictions  are  in  terms  of  the  GATB  tests,  and  the  criterion  tests 
scores  for  the  various  jobs  were  in  GATB  standard  score  terms,  mean 
test  score  values  for  the  two  could  be  directly  compared  for  any  job. 

A somewhat  similar  procedure  was  used  in  deriving  the  prediction  cut- 
off score  criterion  values,  which  were  one  standard  deviation  below  the 
mean  of  the  scores  of  incumbents  on  the  individual  jobs. 
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APPENDIX  E 


Job  Dimensions  Based  on  Principal  Components 
Analyses  of  PAQ  Data  for  2200  Jobs 


No. 

Tech-nical  title 

Operational  title 

Div'sion 

Dimensions 

Division  1;  Information  Input 

1. 

Perceptual  interpretation 

Interpreting  what  is  sensed 

2. 

Input  from  representational 
sources 

Using  various  sources 
of  information 

3. 

Visual  input  from 
devices/materials 

Watching  devices/materials  for 
information 

4. 

Eval uating/ judging 
sensory  input 

Evaluating/ judging  what  is 
sensed 

5. 

Environmental  awareness 

Being  aware  of  environmental 
conditions 

6. 

Use  of  various  senses 

Using  various  senses 

Division  2:  Mental  Processes 

7. 

Decision  making 

Making  decisions 

8. 

Information  processing 

Processing  information 

Division  3:  Work  Output 

9. 

Using  machines/tools/ 
equipment 

Using  machines/tools/ 
equipment 

10. 

General  body  vs. 

sedentary  activities 

Performing  activities  requiring 
general  body  movements 

11. 

Control  and  related  physical 
coordination 

Controlling  machines/ 
processes 

12. 

Skilled/technical  activities 

Performing  skilled/technical 
activities 

13. 

Controlled  manual /related 
acti vi ties 

Performing  controlled 

manual/related  activities 

i 


14. 


Use  of  miscellaneous 
equipment/devices 


Using  miscellaneous  equipment/ 
devices 
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APPENDIX  E (Cont.) 

Job  Dimensions  Based  on  Principal  Components 
Analyses  of  PAQ  Data  for  2200  Jobs 


Technical  title 


Operational  title 


15.  Handling/manipulating/ 

related  activities 

16.  Physical  coordination 


Performing  handling/related 
manual  activities 

General  physical  coordination 


Division  4:  Relationships  With  Other  Persons 

17.  Interchange  of  judgmental/  Communicating  judgments/ 


related  information 


related  information 


General  personal  contact 


Supervisory/coordi nation/ 
related  activities 


Engaging  in  general 
personal  contacts 

Performing  supervisory/ 

coordination/ related  activities 


Job-related  communications  Exchanging  job-related 

information 


Public/related  personal 
contacts 


Publ ic/ related  personal  contacts 


Division  5:  Job  Context 


22.  Potentially  stressful/  E 

unpleasant  environment 

23.  Personally  demanding  1 

situations 

24.  Potentially  hazardous  E 

job  situations 

Division  6:  Other  Job  Characteristics 

25.  Non-typical  vs.  typical  I 

day  work  schedule 

26.  Businesslike  situations  V 


Being  in  a stressful/ 
unpleasant  environment 

Engaging  in  personally 
demanding  situations 

Being  in  hazardous 
job  situations 


Working  non-typical  vs. 
day  schedule 

Working  in  businesslike 
situations 


Optional  vs.  specified 
apparel 

Variable  vs.  salary 
compensation 


Wearing  optional  vs. 
specified  apparel 

Being  paid  on  a variable  vs. 
salary  basis 
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APPENDIX  E (Cont.) 


Job  Dimensions  Based  on  Principal  Components 
Analyses  of  PAQ  Data  for  2200  Jobs 


No. 

Technical  title 

Operational  title 

29. 

Regular  vs.  irregular 
work  schedule 

Working  on  a regular  vs. 
irregular  schedule 

30. 

Job  demanding  ■ 

responsibilities 

Working  under  job-demanding 
ci rcumstances 

31. 

Structured  vs.  unstructured 
job  activities 

Performing  structured  vs. 
unstructured  work 

32. 

Vigilant/discriminating 
work  activities 

Being  alert  to  changing 
conditions 

Overall  Dimensions 

33. 

Decision/communication/ 
general  responsibilities 

Having  decision,  communicating, 
and  general  responsibilities 

34. 

Machine/equipment  operation 

Operating  machines/equipment 

35. 

Clerical /related  activities 

Performing  clerical/ 
related  activities 

36. 

Technical/related 
acti vi ties 

Performing  technical/ 
related  activities 

37. 

Service/related  activities 

Performing  service/related 
activities 

38. 

Regular  day  schedule  vs. 
other  work  schedules 

Working  regular  day  vs. 
other  work  schedules 

39. 

Routine/repetitive  work 
activities 

Performing  routine/ 
repetitive  activities 

40. 

Environmental  awareness 

Being  aware  of  work 
environment 

41  . 

General  physical  activities 

Engaging  in  physical  activities 

42. 

Supervising/coordinating 
other  personnel 

Supervising/coordinating 
other  personnel 

43. 

Public/customer/ related 
contact  activities 

Publ ic/customer/rel ated 
contacts 

44.  Working  in  physically  Working  in  an  unpleasant/ 


. unpleasant/  hazardous/  hazardous/demanding/environment 
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Job  Dimensions  Based  on  Principal  Components 
Analyses  of  PAQ  Data  for  2200  Jobs 


No. 

Technical 

title 

Operational  title 

45. 

Unnamed 

Unnamed 

Source: 

Mecham, 

February  1977. 

a 


4 Dr.  Marshall  J.  Farr,  Director 

Personnel  & Training  Research  Programs 
Office  of  flavay  Research  (Code 
Arlington,  VA  2F'217 

1 Oi'lR  Branch  Office 
49'j  SuirjTier  Street 
Boston,  IIA  02210 
Attn:  Or.  Jan.es  Lester 

1 CNR  Branch  Office 
1030  Last  Green  Street 
Pasadena,  CA  91101 
Attn:  Dr.  Liigene  Gloyc 

) OMR  Branch  Office 
536  S.  Clark  Street 
Chicago,  II.  60605 
Attn:  Dr.  Charles  E.  Davis 

1 Dr.  M.  A.  Bertin,  Scientific  Director 
Office  of  Naval  Research 
Scientific  Liaison  Group/Tokyo 
American  Embassy 
APO  San  Francisco  96503 

1 Office  of  Naval  Research 
Code  200 

Arlington,  VA  22217 


5 Commanding  Officer 

Naval  Research  Laboratory 
Code  2627 

Washington,  DC  20390 

1 Director,  Human  Resource  Management 
Naval  Amphibious  School 
Naval  Amphibious  Base,  Little  Creek, 
Norfolk,  VA  23521 


1 LCDR  Charles  J.  Theisen,  Jr.,  MSC,  USN 
4024 

Naval  Air  Development  Center 
Warminster,  PA  18974 


1 Conifnandiii'^  Officer 

U.S.  N'ivol  Amphibious  School 
Coronado,  f,A  92155 

1 CDR  Paul  D.  Nelson,  MSC,  USN 

Naval  Medical  RSD  Comfuard  (Code  44 
Nation.il  Naval  Medical  center 
Bet.hcsda,  MD  20014 

1 Conmianding  Officer 

Naval  Health  Research  Center 
San  Diego,  CA  92152 
Attn:  Library 

1 Chairman,  Leadership  & Law  Dept. 
Div.  of  Professional  Developcient 
U.  S.  Naval  Academy 
Annapolis,  MO  21402 

1 Scientific  Advisor  to  the  Chief 
of  Naval  Personnel  (Pers  Or) 
Naval  Bureau  of  Personnel 
Room  4410,  Arlington  Annex 
Washington,  DC  20370 

1 Dr.  Jack  R.  Borsting 
Provost  & Academic  Dean 
U.  S.  Naval  Postgraduate  School 
Monterey,  CA  93940 

1 Mr.  Maurice  Callahan 
NOD AC  (Code  2) 

Dept,  of  the  Navy 

Bldg.  2,  Washington  Navy  Yard 

(Anacostia) 

Washington,  DC  20374 

1 Office  of  Civilian  Personnel 
Code  342/02  WAP 
Washington,  DC  20390 
Attn:  Dr.  Richard  J.  Niehaus 

1 Office  of  Civilian  Personnel 
Code  263 

Washington,  DC  20390 


Superintendent  (Code  1424) 

Naval  Postgraduate  School 
Monterey,  CA  93940 

Dr.  H.  M.  West  III 
Deputy  ADCNO  for  Civilian  Planning 
and  Programming  (Acting) 

Room  2625,  Arlington  Annex 
Washington,  DC  20370 


1 Mr.  George  N.  Graine 
Naval  Sea  Systems  Command 
SEA  047C12 

Washington,  DC  20362 

1 Cnief  of  Naval  Technical  Training 
Naval  Air  Station  Memphis  (75) 
Millington,  TN  38054 
Attn.  Dr.  Norman  J.  Kerr 

! Principal  Civil ian  Advisor 

for  Education  and  Training 
Naval  Training  Command,  Code  OOA 
Pensacola,  FL  32508 
Attn:  Dr.  William  L.  Maloy 

1 Dr.  Alfred  F.  Smode,  Director 

Training  Analysis  & Evaluation  Group 
Department  of  the  Navy 
Orlando,  FL  32813 

1 Chief  of  Naval  Education  and 
Training  Support  (OlA) 

Pensacola,  FL  32509 

1 Naval  Undersea  Center 
Code  303 

*'an  Diego,  CA  92132 
Attn:  W.  Gary  Thomson 

1 Navy  Personnel  RSD  Center 
Cede  01 

San  Diego,  CA  92152 

5 A.  A.  Sjoholm,  Head,  Technical  Support 
Navy  Ptisonnel  R&D  Center 
Code  201 

San  Diego,  CA  92152 


2 Mo  <y  I'crsennel  RAD  Center 
Code  Tin 

San  D1rgo,  CA  92152 
Attn;  Dr.  Martin  F.  Wiskoff 

1 Dr.  Robert  Morrison 

Navy  Personnel  RSD  Center 
Code  301 

San  Diego,  CA  92152 

1 Navy  Personnel  RSD  Center 
San  Diego,  CA  92152 
Attn:  Library 

! Toj.-.iiical  Director 

U.S.  A-.:iy  Research  Institute  for  tlie 
behavioral  S Social  Sciences 
SOJl  Ei  so:. Power  Avenue 
Alexandria,  VA  22333 

1 Armed  Forces  Staff  College 
Norfolk,  VA  23511 
Attn:  Library 

1 Co.'Liandant 

U.  £.  Arr;y  Infantry  School 
Fort  Benning,  GA  31905 
Attn:  ATSH-I-V-IT 

1 CorriTiandant 

U.  S.  Ar;iiy  Institute  of  Administration 
Attn:  EA 

Fort  Benjamin  Harrison,  IN  46216 

1 Dr.  Ralph  Dusek 

U.S.  Arn'.y  Research  Institute 
SSj'!  Eisenho.vor  Avenue 
Alexandria,  VA  22333 

t 

1 Dr.  Joseph  Ward 

J.S.  Army  Research  Institute 
SOjI  bisjnha./or  Avc.iue 
A I ca.i  r.  Jr  i a , VA  22333 

1 Dr.  Ralph  Canter 

U.S.  Research  Institute 
5C91  L . senhower  Ave:.ue 
A’.:  . ^ndria,  VA  22333 


Dr.  V.ilton  S.  Katz,  Chief 
Inuividual  Training  & Performance 
Cvcaluation  Technical  Area 
U.S.  Mi'iiiy  Research  Institute 
bODl  Eisenhower  Avenue 
Alexandria,  VA  22333 


1 Air  University  Library 
AUL/LSE  76-443 
Maxwell  AFB,  AL  36112 


Marine  Corps 


1 rlQ  USAREUE  & 7th  Army 
ODCSOPS 

'JSAREUR  Director  of  GED 
APO  New  York  09403 

1 ARI  Field  Unit  - Leavenworth 
P.  0.  Pox  3122 
Ft.  Leavenworth,  KS  66027 

1 DCDR,  USAADMINCEN 
Dldg.  ,11 , A310 
Attn.  AT21-0ED  Library 
Ft.  Benjamin  Harrison,  IN  46216 

/ Research  Branch 
Af  MPC/DPM'YP 

Randolph  AFB,  TX  78148 

1 AFHRL/AS  (Or.  G.  A.  Eckstrand) 
Wrifjht-Patterson  AFB 
Ohio  45433 

A 

1 Dr.  Marty  Rockway  (AFIIRL/TT) 
Lowry  AFB 
Colorado  80230 


1 Director,  Office  of  Manpower 
Uti 1 ization 

HO,  Marine  Corps  (Code  MPU) 
BCB,  Building  2009 
Ouantico,  VA  22134 

1 Dr.  A.  L.  Slafkosky 
Scientific  Advisor  (Code  RD-1) 
HQ,  U.S.  Karine  Corps 
VJashington,  DC  20380 


Coast  Guard 

1 Mr.  Joseph  J.  Cov/an,  Chief 

Psycliological  Research  Branch  (G-P-1/62) 
U.S.  Coast  Guard  Headquarters 
Washington,  DC  20590 

1 Dr.  Harold  F.  O'Neil,  Jr. 

Advanced  Research  Projects  Agency 
Cybernetics  Technology,  Room  623 
1400  Wilson  Blvd. 

Arlington,  VA  22209 


1 Dr.  Alfred  R.  Fregly 
AFOSK/NL,  Building  410 
Boll ing  AFB,  DC  20332 

T Dr.  Sylvia  R.  Mayer  (MCIT) 

HQ  Electronic  Systems  Division 
LG  Hanscom  Field 
Bedford,  MA  01730 


1 Air  Force  Hu:non  Resources  Lab 
AFtIRL/PLD 

Brooks  AIB,  TX  73235 

1 Major  Wayne  S.  Sellman 
Chief,  Personnel  Testing 
AFMPC/DPMYO 

Randolph  AFD,  TX  78148 


1 Mr.  Frederick  W.  Suffa 

Chief,  Recruiting  and  Retention  Evaluation 
Office  of  the  Assistant  Secretary  of 
Defense,  MiRA 
Room  3D970,  Pentagon 
Washington,  DC  20301 

12  Defense  Documentation  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  22314 
Attn:  TC  v 

1 Military  Assistant  for  Human  Resources 
Office  of  the  Director  of  Defense 
Research  & Engineering 
Room  3D129,  The  Pentagon 
Washington,  DC  20301 


1 Director,  Hanagenent  Information 
Systems  Office 

OSD,  M&RA 

Room  3B917,  the  Pentagon 

Washington,  DC  20301 

ther  Government 

T Dr.  Lorrair.e  D.  Eyde 
Personnel  R&D  Center 
U.S.  Civil  Service  Commission 
' 1900  E Street  NW 

l.'ashington,  DC  20415 

T Dr.  William  Gorham,  Director 
Personnel  RSD  Center 
U.S.  Civil  Service  Commission 
1900  E Street  NW 
Wasliington,  DC  20415 

. “1  Dr.  Vorn  Urry 

Personnel  R&D  Center 
U.S.  Civil  Service  Commission 
1900  E Street  NW 
Washiiigton,  DC  20415 

1 U.S.  Civil  Service  Commission 
Federal  Office  Building 
Chicacio  Regional  Staff  Division 
Regional  Psycliologist 
230  S.  Dearborn  Street 
Chicago,  IL  60604 
Attn:  C.  S.  Winiewicz 

1 Dr.  Joseph  L.  Young,  Director 
Memory  & Cognitive  Processes 
r.ational  Science  Foundation 
Washington,  DC  20550 

1 Robert  W.  St'/np 
Natioml  Institute  of  Education  1 

I Washington,  DC  20200 

i Dr.  Scarvia  B.  Anderson 

[Educational  Testing  Service 

Suite  1040  1 

3445  Peachtree  Road  NE 
Atlanta,  GA  30326 


1 Mr.  Samuel  Ball 

Educational  Testing  Service 
Princeton,  NJ  08540 

1 Dr.  Gerald  V.  Barrett 
University  of  Akron 
Dept,  of  Psychology 
Akron,  OH  44325 

1 Dr.  Bernard  M.  Bass 
University  of  Rochester 
Graduate  School  of  Management 
Rochester,  NY  14627 

1 Dr.  Philip  G.  Bernard 
B-K  Dynamics i Inc. 

15825  Stiady  Grove  Road 
RcckviHe<  M^l  20050 

1 Century  Research  Corporation 
4113  Lee  Highway 
Arlington,  VA  22207 

1 Dr.  A.  Charnes 
BEB  203E 

University  of  Texas 
Austin,  TX  78712 

1 Dr.  Kenneth  E.  Clark 

College  of  Arts  & Sciences 
University  of  Rochester 
River  Campus  Station 
Rochester,  NY  14627 

Dr.  Norman  Cliff 
Dept,  of  Psychology 
University  of  Southern  California 
University  Park 
Los  Angeles,  CA  90007 

Dr.  John  J.  Collins 
Essex  Corporation 
6305  Caminito  Estrellado 
San  Diego,  CA  92120 

Dr.  Joseph  E.  Champoux 
iSchool  of  Business  & Administra 
University  of  New  Mexico 
Albuquerque,  NM  87131 


I 


<♦ 


1 


Prof.  W.  W.  Cooper 
Graduate  School  of  Business 
Administration 
Harvard  University 
Boston,  MA  02163 

1 Dr.  Rene  V.  Dawis 
Dept,  of  Psychology 
University  of  Minnesota 
Minneapolis,  MN  55455 

1 Dr.  Robert  Dubin 

University  of  California 
Graduate  School  of  Administration 
Irvine,  CA  926G4 

1 Dr.  Marvin  D,  Dunnette 
Dept,  of  Psychology 
University  of  Minnesota 
Minneapolis,  MN  55455 

1 ERIC  Facility-Acquisitions 
4833  Rugby  Avenue 
Bethcsda,  MD  20014 

1 Major  I.  N.  Evonic 

Canadian  Forces  Personnel 
Applied  Research  Unit 
1107  Avenue  Road 
Toronto,  Ontario,  CANADA 

1 Dr.  Richard  L.  Ferguson 

The  American  Colleae  Testing  Program 

P.  0.  Box  163 

Iowa  City,  lA  52240 

1 Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1 Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organizatior 
8555  sixteenth  Street 
Silver  Spring,  MD  20910 

1 Dr.  John  R.  Frederiksen 
Bolt  Beranek  & Nr.v/iiian,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 


i Dr.  Robert  Glaser,  Co-Director  ■ 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

I Dr.  Gloria  L.  Grace 

System  Development  Corporation 

2500  Colorado  Avenue  i 

Santa  Monica,  CA  90406 

i Dr.  Richard  S.  Hatch 

Decision  Systems  Assoc.,  Inc. 

5640  Nicholson  Lane 
Rockville,  MD  20852 

' Dr.  M.  D.  Havron 

Human  Sciences  Research,  Inc. 

‘^710  Old  Spring  House  Road 
West  Gate  Industrial  Park 
l/Leari,  VA  22101 

1 Human  Resources  Research  Organization 

400  Plaza  Bldg.  , 

Face  Blvd.  at  Fairfield  Drive 
Pensacola,  FL  32505 

I HuiiiRRO/Western  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 
Attn:  Library 

1 HumRRO/Coli.mbus  Office 

Suite  23,  2601  Cross  Country  Drive 
Columbus.  GA  31906 

1 HumRRO/Western  Division 
27857  Berwick  Drive 
Carmel , CA  93921 
Attn;  Dr.  Robert  Vineberg 

1 Dr.  Lawrence  B.  Johnson 

Lawrence  Johnson  & Associates,  Inc. 

Suite  502 

2001  S Street  NW 

Washington,  DC  20009 

1 Dr.  Arnold  F.  Kanarick  , 

Honeywell,  Inc. 

2600  Ridgeway  i’kwy. 

Minneapolis,  MN  55413 


I 


I 


1 Dr.  Royer  A.  Kaufman 
203  Dodd  Hall 
Florida  State  University 
Tallaliasses,  FL  32306 


Dr.  Steven  W.  teele 
Dept,  of  Psychology 
University  of  Oregon 
Eugene,  OR  97^03 


Dr.  Ezra  S.  Krendel 
Wharton  School , DH/CC 
Univ.  of  Pennsylvania 
Philadelphia,  PA  19174 


1 Dr.  Frederick  M.  Lord 

Educational  Testing  Service 
Princeton,  NJ  08540 


1 Or.  Robert  R.  Mackic 

Human  Factors  Research,  Inc. 
6780  Corton  Drive 
Santa  Barbara  Research  Park 
Goleta,  CA  93017 


1 Mr.  Edmond  Marks 
304  Grange  Bldg. 

Pennsylvania  State  University 
University  Park,  PA  16802 


Dr.  Leo  Munday 
Houghton  Mifflin  Co. 
P.  0.  Box  1970 
Iowa  City,  I A 52240 


1 Richard  T.  Mowday 

College  of  Business  Administration 

University  of  Oregon 

Eugene,  OR  97403  i 


Mr.  Luigi  Petrullo 
2431  N.  Edgewood  Street 
Arlington,  VA  22207 


1 Dr.  Lyman  W.  Porter,  Dean 

Graduate  School  of  Administration 
University  of  California 
Irvine,  CA  92717 


1 Dr.  Diane  M.  Ramsey-Klee 
R-K  Research  & System  Design 
3947  Ridgoinont  Drive 
Kalibu,  CA  90265 


Dr.  Steven  M.  Pine 
N 660  Elliott  Hall 
University  of  Minnesota 
75  East  River  Road 
Minneapolis,  HH  55455 


R.Dir.  M.  Rauch 
P II  4 

Burdesministerium  dcr  Verteidigung 
Pcstfach  161 
53  Bonn  1,  GERMANY 


Dr.  Joseph  W.  Rigney 
University  of  So.  California 
Behavioral  Technology  Laboratories 
3717  South  Grand 
Los  Angeles,  CA  90007 


1 Dr.  Andrew  M.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 


Dr.  Leonard  L.  Rosenbaum,  Chairman 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 


Dr.  Benjamin  Schneider 
Dept,  of  Psychology 
University  of  Maryland 
College  Park,  MD  20742 


1 Dr.  Lyle  Schoenfeldt 
School  of  Management 
Rensselaer  Polytechnic  Institute 
Troy,  NY  12181 


Or.  Mark  D.  Reckase 
Educational  Psychology  Dept. 
University  of  Mi ssouri -Columbia 
12  Hill  Hall 
Columbia,  MO  65201 


1 Dr.  Richard  Snow 
Stanford  University 
School  of  Education 
Stanford,  94305 


1 Dr.  C.  Harold  Stone 
1428  Virginia  Avenue 
Glendale,  CA  91202 

1 Mr.  Dennis  J.  Sullivan 

c/o  Canyon  Research  Group,  Inc. 
32107  Lindero  Canyon  Road 
Westlake  Village,  CA  91360 

1 Dr.  David  J.  Weiss 
Dept,  of  Psychology 
N660  Clliott  Hall 
University  of  Minnesota 
Minneapolis,  MN  b5455 

1 Dr.  Anita  West 

Denver  Research  Institute 
University  of  Denver 
Denver,  CO  80201 


1 Dr.  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 


1 Dr.  John  Wannous 
Dept,  of  Management 
Michigan  State  University 
East  Lansing,  MI  48823 

^ Dr.  Frank  Pratzner 

The  Center  for  Vocational  Education 
Ohio  State  University 
1960  Kenny  Road 
Columbus,  Ohio  43210 


